a year ago
高等级的免费爬虫MCP, 完全 Markdown 化支持，支持微信公众号等一大批国内网站。A powerful web crawler designed specifically for LLM applications, capable of extracting clean, readable content from various web pages and converting it to Markdown format. This tool is essential for building knowledge bases, training data collection, and content aggregation for LLM applications. It includes built-in support for the Model Context Protocol (MCP) for enhanced context management.
Server Config
{
"mcpServers": {
"langgraph-crawler": {
"command": "npx",
"args": [
"-y",
"@langgraph-js/crawler-mcp@latest"
]
}
}
}