WebSearch - Advanced Web Search and Content Extraction Tool
@m4s1t4
Web Search tools are a series of tools that allow Claude to acces de internet via MCP Server
Overview
What is WebSearch - Advanced Web Search and Content Extraction Tool?
A Python-based web search and content extraction tool that leverages the Firecrawl API for advanced web scraping, searching, and content analysis. It is built as a Model Context Protocol (MCP) server for seamless integration with MCP clients.
How to use WebSearch - Advanced Web Search and Content Extraction Tool?
Install the uv package manager, clone the repository, create a virtual environment, install dependencies with uv sync, and set required environment variables (Firecrawl API key, optionally OpenAI and Tavily keys). Then configure the MCP server in Claude for Desktop’s claude_desktop_config.json by adding the server command pointing to main.py. The server exposes four tools: Search, Extract, Crawl, and Scrape.
Key features of WebSearch - Advanced Web Search and Content Extraction Tool
- Advanced Web Search with customizable parameters
- Content extraction using natural language prompts
- Web crawling with configurable depth and limits
- Web scraping supporting multiple output formats
- MCP integration for seamless tool access
Use cases of WebSearch - Advanced Web Search and Content Extraction Tool
- Perform intelligent web searches and retrieve structured results
- Extract specific information from web pages via natural language prompts
- Crawl websites with configurable depth and page limits
- Scrape web pages and optionally capture screenshots
FAQ from WebSearch - Advanced Web Search and Content Extraction Tool
What API keys are required?
Firecrawl API key is required; OpenAI and Tavily API keys are optional for enhanced features.
How do I configure the server for Claude for Desktop?
Add the server to your claude_desktop_config.json with the command uv --directory /absolute/path/to/WebSearch run main.py.
What should I do if I encounter errors?
Ensure all required API keys are set in the .env file, verify they are valid and not expired, and check that the .env file is in the project root directory.
What are the runtime dependencies?
Python 3.8+, the uv package manager, and the Firecrawl API (with optional OpenAI and Tavily APIs).
