#web-crawler

Firecrawl Mcp Server

mendableai

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Tavily Mcp

tavily-ai

Production ready MCP server with real-time search, extract, map & crawl.

Web Scout MCP Server

pinkpixel-dev

A powerful MCP server extension providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content programmatically.

mcp-server-webcrawl

pragmar

MCP server tailored to connecting web crawler data and archives

Anycrawl - Turn Any Website Into Llm Ready

any4ai

AnyCrawl MCP Server, with Scrape, Crawl and SERP.

Infomesh

dotnetpower

🕸️ Fully decentralized P2P search engine for LLMs — no API key, no billing, forever free. MCP-native web search via Kademlia DHT + libp2p + FTS5. Production stable ✅ → pip install infomesh

高等级的免费爬虫MCP, 完全 Markdown 化支持，支持微信公众号等一大批国内网站。A powerful web crawler designed specifically for LLM applications, capable of extracting clean, readable content from various web pages and converting it to Markdown format. This tool is essential for building knowledge bases, training

Librecrawl Technical Seo Audit Mcp

adityaarsharma

Open-source self-hosted technical SEO audit MCP server built on the LibreCrawl engine. Runs full audits inside Claude, Cursor, or Codex — 37 tools, 50+ checks per audit (hreflang, schema.org Rich Results, security headers, image performance, WAF detection on 200-OK pages), chunke

Web Scout MCP 🌐

suebksnn

A powerful MCP server extension providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content programmatically.

MCP Web Search Crawler

tomas-hanzlik

A lightweight MCP server for web searching via DuckDuckGo and extracting page content as Markdown.

Aluvia

aluvia-connect

Give your AI agent unblockable browser access. Aluvia routes traffic through premium mobile carrier IPs to bypass 403s, CAPTCHAs, and WAFs automatically.

MCP Server for Driflyte (https://console.driflyte.com).