广告合作
MCP.so
登录

MCP Server Webcrawl

@pragmar

代码仓库主页

基本信息

分类

其他

许可证

NOASSERTION

传输方式

stdio

作者

pragmar

关于 MCP Server Webcrawl

MCP server tailored to connecting web crawler data and archives

#mcp#wget#knowledgebase#warc#llm#mcp-servers#mcp-server

MCP Server Webcrawl 配置

暂无标准配置

该服务器的 README 中没有可解析的 MCP 配置块，请前往代码仓库查看安装说明。

代码仓库

MCP Server Webcrawl 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is mCP Server WebCrawl?

mcp-server-webcrawl provides advanced search and retrieval for web crawler data. It allows AI clients to filter and analyze web content via a fulltext search with boolean support and resource filtering by type, HTTP status, and more. It is designed for users of Claude Desktop who work with data from crawlers like ArchiveBox, HTTrack, or wget.

How to use mCP Server WebCrawl?

mcp-server-webcrawl requires Python (>=3.10) and is installed via pip install mcp-server-webcrawl. After installation, it is configured as an MCP server for Claude Desktop. It can also run in interactive mode as a terminal search tool for web archives without an AI client.

Key features of mCP Server WebCrawl

  • Claude Desktop ready
  • Multi-crawler compatible (ArchiveBox, wget, and more)
  • Filter resources by type, HTTP status, and more
  • Boolean search with field-specific and fulltext queries
  • Support for Markdown, snippets, regex, and XPath extras

Use cases of mCP Server WebCrawl

  • SEO audits of crawled website content
  • Broken link detection and pattern analysis
  • Website performance and optimization analysis
  • File organization and asset composition review
  • Searchable web archive in a terminal via interactive mode

常见问题

1

What web crawlers does mCP Server WebCrawl work with?

It works with ArchiveBox, HTTrack, InterroBot, Katana, SiteOne, WARC format, and wget.

2

What are the system requirements for mCP Server WebCrawl?

It requires Python version 3.10 or higher and the Claude Desktop application.

3

Is mCP Server WebCrawl free and open source?

Yes, it is free and open source.

4

What search syntax does mCP Server WebCrawl support?

It supports boolean operators (AND, OR, NOT), exact phrase matching, wildcards, field-specific searches (e.g., `type: html`, `status: 200`), and complex grouped expressions.

评论

其他 分类下的更多 MCP 服务器

Lemon.io

lemon-io

Request dedicated senior developers to work on your project, write job descriptions, and prep technical interviews — all without leaving your Claude chat. Just describe what you need, and Lemon.io MCP does the rest. 1–3

Yuppsy

Yuppsy MCP: build and publish real estate websites from your AI assistant. Yuppsy lets your AI assistant create live websites for real estate agents and individual property listings. You don't need a designer or any code

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K

Glasswarp

Glasswarp

See and control a real Windows PC you own — from any MCP client, locally or remotely. Observe (UIA + screenshots), click/type/drag/scroll, launch apps, owner Live View. BYOH: your machine, your key.

Awesome Mlops

visenger

A curated list of references for MLOps

14.0K
广告合作