MCP Webscan Server

What is MCP Webscan Server?

MCP Webscan Server is a Model Context Protocol (MCP) server for web content scanning and analysis. It provides tools for fetching, analyzing, and extracting information from web pages, and is designed for use with MCP clients like Claude Desktop.

How to use MCP Webscan Server?

Install by cloning the repository, running npm install and npm run build. Start the server with npm start. The server runs on stdio transport and is configured in Claude Desktop settings using the command node path/to/dist/index.js. Use the available tools (fetch_page, extract_links, crawl_site, check_links, find_patterns, generate_sitemap) in your conversations.

Key features of MCP Webscan Server

• Fetch web pages and convert them to Markdown
• Extract and analyze links from web pages
• Recursively crawl websites to discover content
• Check for broken links on web pages
• Find URLs matching specific regex patterns
• Generate XML sitemaps for websites

Use cases of MCP Webscan Server

• Fetch a web page and convert it to Markdown for easy analysis
• Extract all links from a page along with their anchor text
• Recursively crawl a website to discover all available URLs
• Identify broken links on a page to improve site maintenance
• Find URLs matching a custom pattern using regex
• Generate a simple XML sitemap for a website

FAQ from MCP Webscan Server

What are the runtime requirements?

Node.js 18 or higher and npm are required.

How is MCP Webscan Server started?

Run npm start from the project directory; the server listens on stdio transport.

How do I use MCP Webscan Server with Claude Desktop?

Add a configuration entry in your Claude Desktop settings under mcpServers with the command node and the path to the compiled dist/index.js file.

What tools does MCP Webscan Server provide?

It provides six tools: fetch_page, extract_links, crawl_site, check_links, find_patterns, and generate_sitemap. Each has specific parameters documented in the README.

How are errors handled?

The server implements comprehensive error handling for invalid parameters, network errors, content parsing errors, and URL validation, all formatted according to the MCP specification.