Fetch MCP Server

@jae-jae

代码仓库主页

基本信息

分类

浏览器自动化

许可证

MIT

传输方式

stdio

作者

jae-jae

关于 Fetch MCP Server

MCP server for fetch web page content using Playwright headless browser.

#fetch #web-scraping #playwright

Fetch MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": [
        "-y",
        "fetcher-mcp"
      ]
    }
  }
}

Fetch MCP Server 工具

Retrieve web page content from a specified URL

Retrieve web page content from multiple specified URLs

Install Playwright Chromium browser binary. Call this if you get an error about the browser not being installed.

概览

What is Fetch MCP?

Fetch MCP is an MCP server that uses Playwright headless browser to fetch web page content. It handles dynamic JavaScript-rendered pages and intelligently extracts main content, supporting both HTML and Markdown output. Designed for developers integrating web content into MCP-compatible applications like Claude Desktop.

How to use Fetch MCP?

Run directly via npx -y fetcher-mcp after installing the Chromium browser with npx playwright install chromium. Configure the server in your MCP client (e.g., Claude Desktop) by adding its command to the claude_desktop_config.json. Optionally start with --transport=http for HTTP/SSE endpoints, or use Docker deployments.

Key features of Fetch MCP

JavaScript execution via Playwright for dynamic content
Intelligent main content extraction (Readability algorithm)
Supports both Markdown and HTML output formats
Parallel fetching of multiple URLs (fetch_urls tool)
Blocks unnecessary resources (images, styles, fonts, media)
Configurable parameters (timeout, extraction, output format)

Use cases of Fetch MCP

Fetching modern web applications that rely on JavaScript rendering
Batch collecting content from multiple URLs simultaneously
Handling sites with anti-crawler mechanisms (CAPTCHA, redirects)
Preserving original HTML structure when extraction is insufficient
Using debug mode to manually authenticate via cookies

常见问题

How is Fetch MCP different from traditional web scrapers?

It uses Playwright to execute JavaScript, enabling it to handle dynamic web content and modern single-page applications that traditional scrapers cannot.

What are the runtime requirements?

Requires Node.js and a Chromium browser installed via Playwright (`npx playwright install chromium`). Docker images are also available.

How do I get HTML instead of Markdown?

Set the `returnHtml` parameter to `true` in the `fetch_url` or `fetch_urls` call, or include a prompt like "Please return the content in HTML format."

How to handle anti-crawler verification pages?

Use the `waitForNavigation` parameter (or prompt "Please wait for the page to fully load") to allow time for CAPTCHAs or redirects to complete. Increase `timeout` if needed.

What transport protocols are supported?

Supports both Streamable HTTP (endpoint `/mcp`) and SSE (endpoint `/sse`) when started with `--transport=http`. Also supports standard MCP stdio transport.

浏览器自动化分类下的更多 MCP 服务器

Fastcrw

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary.

286