广告合作
MCP.so
登录
C

Crawl4ai Middleware MCP Server

@Frankieli123

代码仓库

基本信息

分类

其他

传输方式

stdio

作者

Frankieli123

提交者

关于 Crawl4ai Middleware MCP Server

暂无概览

#crawl4ai#web-scraping#middleware

Crawl4ai Middleware MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "crawl4ai": {
      "command": "python",
      "args": [
        "E:/APP/craw14ai-middleware/crawl4ai_server.py"
      ]
    }
  }
}

Crawl4ai Middleware MCP Server 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is Crawl4ai Middleware?

Crawl4ai Middleware is an MCP (Model Context Protocol) server that integrates crawl4ai's web scraping capabilities into MCP-compatible applications like Cursor IDE. It provides tools to create crawl tasks, retrieve results by task ID, list saved files, and read their contents.

How to use Crawl4ai Middleware?

Install dependencies with pip install mcp[cli] httpx python-dotenv, configure environment variables (API base URL and key), then add the server configuration to your MCP client (e.g., Cursor IDE's settings.json) pointing to the crawl4ai_server.py script.

Key features of Crawl4ai Middleware

  • Provides four MCP tools for web scraping workflows
  • Saves scraped content locally to avoid display size limits
  • Supports environment variable configuration for API and output directory
  • Allows retrieval of crawl results by task ID
  • Lists and reads saved result files
  • Works with Cursor IDE and other MCP-enabled applications

Use cases of Crawl4ai Middleware

  • Scrape a web page and retrieve its content directly in Cursor IDE
  • Manage multiple crawl tasks with persistent file storage
  • Review previously crawled results offline at any time
  • Integrate web scraping into AI agent workflows via MCP

常见问题

1

What tools does Crawl4ai Middleware provide?

It provides `create_crawl_task`, `get_crawl_result`, `list_saved_results`, and `read_saved_result`.

2

How are crawled files stored?

Files are saved in a `url` folder next to the server script, named `extracted_domain_taskID_timestamp.txt`.

3

What dependencies are required?

Install `mcp[cli]`, `httpx`, and `python-dotenv` via pip.

4

How do I configure the server?

Set environment variables `CRAWL4AI_API_BASE`, `CRAWL4AI_API_KEY`, optionally `OUTPUT_DIR` and `LOG_LEVEL`. Default API base is `http://192.168.31.12:11235` and key `sk-3180623`.

5

Can I use this with Cursor IDE?

Yes, add the server configuration to Cursor's `settings.json` with the command `python` and args pointing to the `crawl4ai_server.py` script.

评论

其他 分类下的更多 MCP 服务器

Senso MCP for Joomla

sensomedia

Senso MCP turns a Joomla 5 or 6 site into a remote MCP server. It runs inside Joomla itself (no extra server, no Node.js bridge) and is secured with OAuth 2.1 and Joomla's own ACL. The free pack lets an AI assistant crea

Screenpipe

screenpipe

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

22.0K

Soar Flight Booking MCP

Soar Flight Booking MCP is a remote MCP server available at https://mcp.soar.flights.

The Living Bread

The Living Bread

A free remote MCP server for The Living Bread. Bible passages read word for word from a stored public domain text with an evidence label, keyword search and cross references, real churches, gatherings and prayer groups w

P

PickFu MCP

PickFu MCP is a Model Context Protocol (MCP) server that connects AI assistants, developers, marketers, product managers, and AI agents to PickFu's consumer research platform. It enables users to create surveys, conduct

广告合作