Web Scout MCP Server

@pinkpixel-dev

Repository Homepage

About Web Scout MCP Server

A powerful MCP server extension providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content programmatically.

#crawler #web-crawler #web-scraper #ai-assistant

Basic information

Category

Search

License

Apache-2.0

Runtime

node

Transports

stdio

Publisher

pinkpixel-dev

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "web-scout-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@smithery/cli",
        "install",
        "@pinkpixel-dev/web-scout-mcp",
        "--client",
        "claude"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Web Scout MCP Server?

Web Scout MCP Server is an MCP server that provides web search via DuckDuckGo and clean text extraction from web pages, with support for parallel processing and memory optimizations. It is designed for developers using MCP-compatible clients such as Claude Desktop or Cursor.

How to use Web Scout MCP Server?

Install globally (npm install -g @pinkpixel/web-scout-mcp) and run the web-scout-mcp command, or add the package to your MCP client’s config.json with npx -y @pinkpixel/web-scout-mcp@latest. Set WEB_SCOUT_DISABLE_AUTOSTART=1 if embedding the package programmatically.

Key features of Web Scout MCP Server

DuckDuckGo search with privacy‑focused results
Clean text extraction from web pages
Parallel processing of multiple URLs simultaneously
Smart memory management to prevent crashes
Rate limiting to avoid API blocks
Robust error handling for reliable operation

Use cases of Web Scout MCP Server

Searching the web for up‑to‑date information through an MCP client
Extracting article or documentation content from one or more URLs
Automating research workflows that combine search results with page content
Building AI assistants that need structured, readable web data

FAQ from Web Scout MCP Server

What are the system requirements for Web Scout MCP Server?

Node.js version 18.0.0 or higher and npm or yarn are required.

How can I install Web Scout MCP Server automatically for Claude Desktop?

Use the Smithery CLI: npx -y @smithery/cli install @pinkpixel-dev/web-scout-mcp --client claude

What search engine does Web Scout MCP Server use?

It uses DuckDuckGo for privacy‑focused web search.

What tools does Web Scout MCP Server provide?

It provides DuckDuckGoWebSearch (with query and optional maxResults) and UrlContentExtractor (accepting a single URL or an array of URLs).

How does the server handle rate limiting and memory?

The server includes intelligent request throttling and smart memory management to prevent crashes and API blocks.

Comments

More Search MCP servers

Tavily Mcp

Production ready MCP server with real-time search, extract, map & crawl.

🚀 OneSearch MCP Server: Web Search & Crawl & Scraper & Extract

🚀 OneSearch MCP Server: Web Search & Scraper & Extract, Support agent-browser, SearXNG, Tavily, DuckDuckGo, Bing, etc.

Google Search MCP Server

MCP Server built for use with Claude Code, Claude Desktop, VS Code, Cline - enable google search and ability to follow links and research websites

Bing Search MCP Server

MCP Server for Bing Search API

Perplexity MCP Server

MCP web search using perplexity without any API KEYS