MCP.so
登录

Crawlab MCP Server

@crawlab-team

基本信息

分类

其他

传输方式

stdio

作者

crawlab-team

关于 Crawlab MCP Server

暂无概览

Crawlab MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "crawlab-mcp-server": {
      "type": "http",
      "url": "http://localhost:8000"
    }
  }
}

Crawlab MCP Server 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表,不代表服务没有工具。请查阅项目文档了解支持的能力。

点击上方按钮,直接连接服务器端点实时获取工具列表。

概览

What is Crawlab MCP Server?

The Crawlab MCP Server is a Model Context Protocol (MCP) server that enables AI applications to interact with Crawlab’s spider, task, and file management features through natural language. It bridges an MCP client (such as Claude Desktop) with the Crawlab API, allowing users to create, run, and manage web scraping workflows without manual API calls.

How to use Crawlab MCP Server?

Install as a Python package (pip install -e .) and run the server CLI (crawlab_mcp-mcp server), or run directly with python server.py after setting up a .env file with your Crawlab API base URL and token. A Docker image is also available. Connect an AI client to the server’s URL (e.g., http://localhost:8000) to start issuing natural language commands.

Key features of Crawlab MCP Server

  • MCP‑based communication between AI apps and Crawlab
  • Full spider lifecycle: create, read, update, delete
  • Task management: run, cancel, restart, view logs
  • File operations: list, read, write spider files
  • Supports multiple deployment options (local, Docker, pip)
  • Configuration via environment variables (.env)

Use cases of Crawlab MCP Server

  • Create and configure new spiders using natural language
  • Launch scraping tasks on demand and monitor progress
  • Retrieve and update spider code files through a chat interface
  • Cancel or restart tasks without leaving the AI application

常见问题

1

What is the Crawlab MCP Server?

It is a standard MCP server that translates AI application tool calls into Crawlab API requests, enabling natural‑language control of Crawlab’s spider, task, and file management features.

2

How do I install the Crawlab MCP Server?

You can install it as a Python package (`pip install -e .`) and run via CLI, or run `python server.py` directly. A Docker build is also provided.

3

What are the prerequisites to run the server?

Python 3.8+, a running Crawlab instance, and a valid Crawlab API token. The server connects to Crawlab via its API, so the instance must be accessible.

4

How is authentication handled?

The server reads the Crawlab API token from the `CRAWLAB_API_TOKEN` environment variable (set in `.env`) and uses it to authenticate all requests to the Crawlab API.

5

What transport does the MCP server use?

The server communicates over HTTP. Clients connect to its URL (e.g., `http://localhost:8000`), and tool calls are executed via RESTful API calls to the Crawlab backend.

评论

其他 分类下的更多 MCP 服务器