MCP.so
ログイン

TheCrawler MCP Server

@manchittlab

基本情報

カテゴリ

ブラウザ自動化

最終更新

ライセンス

AGPL-3.0

作者

manchittlab

TheCrawler MCP Server について

Open-source web scraper + LLM-powered structured extraction. PDF/DOCX, markdown, JSON-LD, microdata, commerce data, forms, 16 analytics-tracker detection. Structured errors with retryable flags. Adaptive Cheerio->Playwright. CLI, npm, REST API, and MCP server. AGPL-3.0.

TheCrawler MCP Server の設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "TheCrawler": {
      "command": "node",
      "args": [
        "dist/cli.js",
        "crawl",
        "https://example.com",
        "--markdown"
      ]
    }
  }
}

TheCrawler MCP Server のツール

ツール一覧はまだありません

この掲載には表示できるツール一覧がまだありません。サーバーにツールがないという意味ではありません。対応機能はプロジェクトのドキュメントをご確認ください。

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is TheCrawler?

Open-source web scraper + LLM-powered structured extraction. PDF/DOCX, markdown, JSON-LD, microdata, commerce data, forms, 16 analytics-tracker detection. Structured errors with retryable flags. Adaptive Cheerio->Playwright. CLI, npm, REST API, and MCP server. AGPL-3.0.

How to use TheCrawler?

The README includes setup instructions such as node dist/cli.js crawl https://example.com --markdown.

Key features of TheCrawler

  • Scope: up to 25 public URLs and one target output shape
  • Payment: requested only after the workflow looks like a fit, by one-off $500 payment link or invoice
  • Output: a readiness report with ready, mixed, blocked, or not-worth-automating-yet guidance
  • Credit: if the workflow continues into setup or hosted usage, the $500 is credited toward that next step
  • Crawl mode: $0.005 per page successfully scraped (failed pages don't charge)

Use cases of TheCrawler

  • Connect an MCP-compatible client to this repository's service.
  • Review the README-backed setup before enabling it in production.

よくある質問

1

Where is the source code for TheCrawler?

The source code is linked from the repository URL on this page.

2

Does TheCrawler include a standard MCP config?

If the README contains a parseable MCP configuration block, it is shown in the Config tab.

コメント

「ブラウザ自動化」の他のコンテンツ