Crawler For Llm MCP Server

Name: Crawler For Llm MCP Server
Author: KonghaYao

@KonghaYao

代码仓库

基本信息

分类

浏览器自动化

传输方式

stdio

作者

KonghaYao

提交者

心屿江

关于 Crawler For Llm MCP Server

高等级的免费爬虫MCP, 完全 Markdown 化支持，支持微信公众号等一大批国内网站。A powerful web crawler designed specifically for LLM applications, capable of extracting clean, readable content from various web pages and converting it to Markdown format. This tool is essential for building knowledge bases, training

#web-crawler #markdown-converter #content-extraction#llm-data-preparation#knowledge-base-building#model-context-protocol-mcp

Crawler For Llm MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "langgraph-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "@langgraph-js/crawler-mcp@latest"
      ]
    }
  }
}

Crawler For Llm MCP Server 工具

A powerful web content extraction tool that retrieves and processes raw content from specified URLs, ideal for data collection, content analysis, and research tasks.

A powerful web search tool that provides comprehensive, real-time results using search engine. Returns relevant web content with customizable parameters for result count, content type, and domain filtering. Ideal for gathering current information, news, and detailed web content analysis.

概览

What is Crawler For Llm?

Crawler For Llm is a universal web crawler designed for LLM applications, extracting clean, readable content from web pages and converting it to Markdown. It includes built-in support for the Model Context Protocol (MCP) for enhanced context management, and is intended for building knowledge bases, training data collection, and content aggregation.

How to use Crawler For Llm?

Add the provided MCP server configuration to your project's settings. Use the command npx -y @langgraph-js/crawler-mcp@latest with the server name langgraph-crawler.

Key features of Crawler For Llm

Universal web crawler with MCP integration
Extracts clean content and converts to Markdown
Supports documentation, development, and Chinese platforms
Continuously expanding list of supported websites
Built for LLM knowledge bases and training data

Use cases of Crawler For Llm

Building knowledge bases for LLM applications
Collecting training data from diverse web sources
Aggregating content from multiple platforms

FAQ from Crawler For Llm

—

浏览器自动化分类下的更多 MCP 服务器

playwright-server MCP server

blackwhite084

189

fetch-mcp

egoist

An MCP server for fetching URLs / Youtube video transcript.

156

Fetch

modelcontextprotocol

Model Context Protocol Servers

88.1K

TinyFish

tinyfish

Give your AI agent the live web. One MCP server for Search, Fetch, Browser, and Agent: browse real sites, extract structured data, fill forms, and run multi-step workflows. Search and Fetch are free.

Screenshot Scout

screenshotscout

Capture screenshots of webpages as images or PDFs with Screenshot Scout.