广告合作
MCP.so
登录

Crawl4ai MCP Server

@Kirill812

代码仓库

基本信息

分类

其他

许可证

MIT license

传输方式

stdio

作者

Kirill812

关于 Crawl4ai MCP Server

A Model Context Protocol server that provides web crawling capabilities using Crawl4ai

Crawl4ai MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "crawl4ai": {
      "command": "node",
      "args": [
        "/path/to/crawl4ai-mcp-server/build/index.js"
      ],
      "env": {
        "CRAWL4AI_API_URL": "",
        "CRAWL4AI_AUTH_TOKEN": ""
      }
    }
  }
}

Crawl4ai MCP Server 工具

1

Crawl web pages and get markdown content with citations

概览

What is Crawl4ai MCP Server?

A MCP server that provides web crawling capabilities using crawl4ai, returning markdown content with citations for use by LLMs. It is for developers building AI applications that need to fetch and structure web page content via the Model Context Protocol.

How to use Crawl4ai MCP Server?

Install dependencies with npm install, build with npm run build, then add the server configuration to your MCP client environment, setting CRAWL4AI_API_URL (optional) and CRAWL4AI_AUTH_TOKEN (optional). Invoke the crawl_urls tool with a list of URLs to crawl.

Key features of Crawl4ai MCP Server

  • Single tool crawl_urls accepts a list of URLs
  • Returns markdown content with numbered citations per URL
  • Multiple URLs are separated by horizontal rules
  • Automatically handles retries with different user agents
  • Requires a running crawl4ai API instance (Docker deployment)

Use cases of Crawl4ai MCP Server

  • Providing up-to-date web content as context for LLM prompts
  • Scraping documentation or articles for summarization
  • Aggregating content from multiple URLs into a single markdown response

常见问题

1

What is crawl4ai and do I need it?

Crawl4ai is an external web crawling service. You must have a running crawl4ai instance, typically deployed via Docker, for this server to work.

2

What are the runtime requirements?

Node.js and a running crawl4ai API instance. No other dependencies are needed beyond the npm packages.

3

Where does the web page data live?

The server does not store data; it fetches content from each URL via the crawl4ai API and returns it directly to the MCP client.

4

Are there any known limits or errors?

Timeouts may occur with too many URLs per request. The service handles retries automatically, but you can reduce the number of URLs if problems persist.

5

What transport and authentication are used?

The server uses standard I/O transport for MCP. Authentication to the crawl4ai API is optional via the `CRAWL4AI_AUTH_TOKEN` environment variable.

评论

其他 分类下的更多 MCP 服务器

Activepieces

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

23.2K

EverArt

modelcontextprotocol

Model Context Protocol Servers

88.1K

Handl

Handl speaks the Model Context Protocol. Your whole billing operation — projects, invoices, clients, reports, approvals — as tools any AI assistant can call, inside your autonomy rules.

YOUB

Connect your AI assistant to your own YOUB endurance training account. Read recorded activities with full analysis, planned sessions, race goals, wellness (HRV, sleep, resting HR) and your athletic profile. Create or mov

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K
广告合作