広告掲載
MCP.so
ログイン

MCP Server Webcrawl

@MCP-Mirror

リポジトリ

基本情報

カテゴリ

その他

ライセンス

View license

トランスポート

stdio

作者

MCP-Mirror

MCP Server Webcrawl について

Mirror of

#mcp-server#web-crawl#ai-integration

MCP Server Webcrawl の設定

標準の設定はありません

このサーバーの README には解析可能な MCP 設定ブロックが含まれていません。インストール手順はリポジトリをご確認ください。

リポジトリ

MCP Server Webcrawl のツール

ツール一覧はまだありません

この掲載には表示できるツール一覧がまだありません。サーバーにツールがないという意味ではありません。対応機能はプロジェクトのドキュメントをご確認ください。

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is mcp-server-webcrawl?

mcp-server-webcrawl bridges the gap between your web crawl and AI language models using the Model Context Protocol (MCP). It allows an AI client to filter and analyze web content under your direction or autonomously, and works with a variety of web crawlers (WARC, wget, InterroBot, Katana, SiteOne).

How to use mcp-server-webcrawl?

Install via pip install mcp-server-webcrawl (requires Python ≥3.10 and Claude Desktop). Configure the MCP server in Claude Desktop’s settings file by adding an entry under mcpServers with the command mcp-server-webcrawl and arguments specifying the crawler type and data source path. On macOS, use the absolute path to the executable.

Key features of mcp-server-webcrawl

  • Claude Desktop ready
  • Full-text search with boolean support
  • Filter resources by type, HTTP status, and more
  • Compatible with multiple web crawlers
  • Quick MCP configuration
  • ChatGPT support coming soon

Use cases of mcp-server-webcrawl

  • Search and analyze crawled web archives with natural language queries
  • Filter web content by file type or HTTP status for targeted analysis
  • Enable AI assistants to browse and summarize local crawl data
  • Integrate with various crawler outputs (WARC, wget, etc.) in one tool

よくある質問

1

What crawlers are supported by mcp-server-webcrawl?

mcp-server-webcrawl works with WARC, wget, InterroBot, Katana, and SiteOne.

2

How do I install mcp-server-webcrawl?

Install via `pip install mcp-server-webcrawl`. It requires Python 3.10 or higher and Claude Desktop.

3

How do I configure mcp-server-webcrawl for macOS?

On macOS, you must use the absolute path to the `mcp-server-webcrawl` executable in the `command` field (e.g., `/Users/yourusername/.local/bin/mcp-server-webcrawl`). Run `which mcp-server-webcrawl` to find the correct path.

4

What is the data source argument for mcp-server-webcrawl?

The `--datasrc` argument specifies the directory or database path for the crawled content. Its value depends on the crawler: for wget it’s the parent directory of mirrors; for WARC it’s the parent of WARC files; for InterroBot it’s the direct database path; for Katana and SiteOne it’s the parent directory of archives.

5

What transport does mcp-server-webcrawl use?

mcp-server-webcrawl uses stdio transport as configured in Claude Desktop’s MCP settings via the `command` and `args` fields.

コメント

「その他」の他のコンテンツ

EverArt

modelcontextprotocol

Model Context Protocol Servers

88.1K

Glasswarp

Glasswarp

See and control a real Windows PC you own — from any MCP client, locally or remotely. Observe (UIA + screenshots), click/type/drag/scroll, launch apps, owner Live View. BYOH: your machine, your key.

Blender

ahujasid

Open-source MCP to use Blender with any LLM

23.6K

🚀 Model Context Protocol (MCP) Curriculum for Beginners

microsoft

This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable,

16.7K

DeepMark

DeepMark helps teachers deliver rapid, consistent marking with meaningful feedback for every student — in a fraction of the time. What once took a week, now takes one free period.

広告掲載