What is Claude Web Scraper MCP?
Claude Web Scraper MCP is a Model Context Protocol server that connects Claude for Desktop to a locally running eGet web scraper. It allows Claude to scrape website content through your local API. Designed for users who want Claude to retrieve and analyze web pages.
How to use Claude Web Scraper MCP?
First, ensure the eGet web scraper is running locally (typically at http://localhost:8000/api/v1/scrape). Next, set up the MCP server using UV, install dependencies, and create the scrape_mcp_server.py script. Then, configure Claude for Desktop by adding the server entry in claude_desktop_config.json, pointing to the virtual environment’s Python interpreter and the script path. Restart Claude for Desktop. Once configured, you can use natural language commands like “Scrape the content from https://example.com and summarize it.”
Key features of Claude Web Scraper MCP
- Connects Claude for Desktop to a local eGet web scraper.
- Uses a local API for web scraping (default
http://localhost:8000).
- Simple setup with Python, UV, and MCP SDK.
- Integrates seamlessly with Claude for Desktop via JSON configuration.
- Accepts natural language scrape commands from the user.
- Runs entirely on your local machine—no external service needed.
Use cases of Claude Web Scraper MCP
- Ask Claude to scrape and summarize any public web page.
- Extract specific information from websites (e.g., headlines, prices).
- Have Claude analyze scraped content for research or automation.
评论