Webtools MCP Server
Created at a month ago
by misterboe
Categories
Tags
webtools
mcp-server
web-scraping
what is Webtools MCP Server?
Webtools MCP Server is a Model Context Protocol (MCP) server that provides web scraping and content extraction tools, enabling users to fetch and process web content using MCP-compatible clients.
how to use Webtools MCP Server?
To use the Webtools MCP Server, run the server directly with npx
, or install it globally using npm. After setting it up, you can call its provided tools like webtool_gethtml
and webtool_readpage
with specified parameters to extract content from web pages.
key features of Webtools MCP Server?
- Retrieves raw HTML from any webpage.
- Converts webpage content into clean, formatted Markdown.
- Includes an automatic retry mechanism with exponential backoff.
- Supports optional proxy usage and JavaScript rendering via Puppeteer.
- Intelligent HTML cleaning and formatting, preserving images and links during Markdown conversion.
use cases of Webtools MCP Server?
- Extracting raw HTML data for analysis or processing.
- Formatting website content into Markdown for documentation or blogging.
- Scraping content from JavaScript-heavy websites that require rendering.
FAQ from Webtools MCP Server?
- How do I install Webtools MCP Server?
You can install it using
npx @bschauer/webtools-mcp-server
or globally vianpm install -g @bschauer/webtools-mcp-server
.
- Does it support JavaScript-heavy webpages?
Yes, it supports JavaScript rendering using Puppeteer, which allows it to fetch and process dynamic content.
- Is there proxy support?
Yes, you can enable proxy support by setting the appropriate environment variables.
View More