MCP.so
登录

MCP Web Search Crawler

@tomas-hanzlik

代码仓库

关于 MCP Web Search Crawler

A lightweight MCP server for web searching via DuckDuckGo and extracting page content as Markdown.

#mcp#web-crawler#duckduckgo

基本信息

分类

搜索

运行时

python

传输方式

stdio

发布者

tomas-hanzlik

配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "mcp-web-search-crawl": {
      "command": "uvx",
      "args": [
        "--from",
        "git+https://github.com/tomas-hanzlik/mcp-web-search-crawl",
        "mcpsearchcrawl"
      ]
    }
  }
}

工具

未检测到工具

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is MCP Web Search Crawler?

MCP Web Search Crawler is a Model Context Protocol server that provides web search and crawling capabilities. It enables AI assistants and other MCP clients to search the web using DuckDuckGo and crawl specific URLs to extract content in markdown format.

How to use MCP Web Search Crawler?

Clone the repository, then configure the server in your MCP client using the uv command with a directory argument, or use uvx from the GitHub repository. It exposes a tool called search_links that accepts a query parameter. The server can be run with --transport sse or --transport stdio.

Key features of MCP Web Search Crawler

  • Web Search via DuckDuckGo returning links, titles, and body snippets
  • URL crawling returning content as markdown
  • Configurable via MCP client JSON
  • Programmatic testing with Python client (fastmcp)
  • Supports SSE and stdio transports

Use cases of MCP Web Search Crawler

  • AI assistants searching the web for current information
  • Crawling specific web pages to extract markdown content
  • Combining search and crawl for research tasks
  • Integrating with MCP-compatible clients for automated web data retrieval

FAQ from MCP Web Search Crawler

What dependencies are required?

Requires uv and Python. The server uses DuckDuckGo as its search backend and does not need API keys.

How do I test the server programmatically?

Use the provided Python script with the fastmcp Client, then call tools like search_links with a query parameter.

What transport options are available?

The server supports SSE and stdio transports. Run it with --transport sse or --transport stdio.

How can I debug the server?

Use MCP Inspector with the command: uv run fastmcp dev src/mcp_web_search_crawl/server.py:mcp --with-editable .

评论

搜索 分类下的更多 MCP 服务器

Brave Search

modelcontextprotocol

Model Context Protocol Servers

88.1K

duckduckgo-search MCP Server

zhsama

84

Baidu AI Search

baidubce

appbuilder-sdk, 千帆AppBuilder-SDK帮助开发者灵活、快速的搭建AI原生应用

583

Version 2.0 is here!!

mixelpixx

MCP Server built for use with Claude Code, Claude Desktop, VS Code, Cline - enable google search and ability to follow links and research websites

249

Naver Search MCP Server

isnow890

MCP server for Naver Search API integration. Provides comprehensive search capabilities across Naver services (web, news, blog, shopping, etc) and data trend analysis tools via DataLab API.

77