Advertise
MCP.so
Sign In

MCP Web Search Crawler

@tomas-hanzlik

Repository

Basic information

Category

Search

Transports

stdio

Author

tomas-hanzlik

About MCP Web Search Crawler

A lightweight MCP server for web searching via DuckDuckGo and extracting page content as Markdown.

#mcp#web-crawler#duckduckgo

MCP Web Search Crawler config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "mcp-web-search-crawl": {
      "command": "uvx",
      "args": [
        "--from",
        "git+https://github.com/tomas-hanzlik/mcp-web-search-crawl",
        "mcpsearchcrawl"
      ]
    }
  }
}

MCP Web Search Crawler tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

Fetch the live tool list by running this server in a temporary sandbox using the button above.

Overview

What is MCP Web Search Crawler?

MCP Web Search Crawler is a Model Context Protocol server that provides web search and crawling capabilities. It enables AI assistants and other MCP clients to search the web using DuckDuckGo and crawl specific URLs to extract content in markdown format.

How to use MCP Web Search Crawler?

Clone the repository, then configure the server in your MCP client using the uv command with a directory argument, or use uvx from the GitHub repository. It exposes a tool called search_links that accepts a query parameter. The server can be run with --transport sse or --transport stdio.

Key features of MCP Web Search Crawler

  • Web Search via DuckDuckGo returning links, titles, and body snippets
  • URL crawling returning content as markdown
  • Configurable via MCP client JSON
  • Programmatic testing with Python client (fastmcp)
  • Supports SSE and stdio transports

Use cases of MCP Web Search Crawler

  • AI assistants searching the web for current information
  • Crawling specific web pages to extract markdown content
  • Combining search and crawl for research tasks
  • Integrating with MCP-compatible clients for automated web data retrieval

Frequently asked questions

1

What dependencies are required?

Requires `uv` and Python. The server uses DuckDuckGo as its search backend and does not need API keys.

2

How do I test the server programmatically?

Use the provided Python script with the `fastmcp` Client, then call tools like `search_links` with a query parameter.

3

What transport options are available?

The server supports SSE and stdio transports. Run it with `--transport sse` or `--transport stdio`.

4

How can I debug the server?

Use MCP Inspector with the command: `uv run fastmcp dev src/mcp_web_search_crawl/server.py:mcp --with-editable .`

Comments

More Search MCP servers

Aguasto Research

Aguasto

Official read-only MCP access to Aguasto's public GPU, model and infrastructure research. Search published descriptions and retrieve canonical source links. Anonymous Streamable HTTP; GPU rental and token-based inference

VerifyAPI

Circuit Savers LLC

Fact-check any claim with live web sources. Ed25519-signed receipts. Catches hallucinations.

Singapore Proxy

Singapore Mobile Proxy

Give Claude, Cursor or any MCP agent a real Singapore mobile IP. Fetch pages, run Singapore-localised Google searches and check geo-locked content through physical Singtel and M1 SIMs, with IP rotation on demand. Hosted

S

SaaS Think Tank — Software Research

SaaS Think Tank

Software research to help people choose the right tools. SaaS Think Tank publishes software comparisons, reviews and practical resources across categories, with dated findings, source links and clear limits. Current MCP

Opsis OSINT

Opsis LLC

OSINT search for AI agents. Find the accounts behind an email, username or domain across 1,000+ sources, with verified profiles: names, photos, bios, locations, stats and linked accounts. An account only counts when the

Advertise