MCP.so
登录

TheCrawler MCP Server

@manchittlab

基本信息

分类

浏览器自动化

最近更新

许可证

AGPL-3.0

作者

manchittlab

关于 TheCrawler MCP Server

Open-source web scraper + LLM-powered structured extraction. PDF/DOCX, markdown, JSON-LD, microdata, commerce data, forms, 16 analytics-tracker detection. Structured errors with retryable flags. Adaptive Cheerio->Playwright. CLI, npm, REST API, and MCP server. AGPL-3.0.

TheCrawler MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "TheCrawler": {
      "command": "node",
      "args": [
        "dist/cli.js",
        "crawl",
        "https://example.com",
        "--markdown"
      ]
    }
  }
}

TheCrawler MCP Server 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表,不代表服务没有工具。请查阅项目文档了解支持的能力。

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is TheCrawler?

Open-source web scraper + LLM-powered structured extraction. PDF/DOCX, markdown, JSON-LD, microdata, commerce data, forms, 16 analytics-tracker detection. Structured errors with retryable flags. Adaptive Cheerio->Playwright. CLI, npm, REST API, and MCP server. AGPL-3.0.

How to use TheCrawler?

The README includes setup instructions such as node dist/cli.js crawl https://example.com --markdown.

Key features of TheCrawler

  • Scope: up to 25 public URLs and one target output shape
  • Payment: requested only after the workflow looks like a fit, by one-off $500 payment link or invoice
  • Output: a readiness report with ready, mixed, blocked, or not-worth-automating-yet guidance
  • Credit: if the workflow continues into setup or hosted usage, the $500 is credited toward that next step
  • Crawl mode: $0.005 per page successfully scraped (failed pages don't charge)

Use cases of TheCrawler

  • Connect an MCP-compatible client to this repository's service.
  • Review the README-backed setup before enabling it in production.

常见问题

1

Where is the source code for TheCrawler?

The source code is linked from the repository URL on this page.

2

Does TheCrawler include a standard MCP config?

If the README contains a parseable MCP configuration block, it is shown in the Config tab.

评论

浏览器自动化 分类下的更多 MCP 服务器