Webtools MCP Server

Created at a month ago

by misterboe

starstarstarstarstar

Categories

developer-tools

Tags

webtools

mcp-server

web-scraping

Webtools MCP Server

what is Webtools MCP Server?

Webtools MCP Server is a Model Context Protocol (MCP) server that provides web scraping and content extraction tools, enabling users to fetch and process web content using MCP-compatible clients.

how to use Webtools MCP Server?

To use the Webtools MCP Server, run the server directly with npx, or install it globally using npm. After setting it up, you can call its provided tools like webtool_gethtml and webtool_readpage with specified parameters to extract content from web pages.

key features of Webtools MCP Server?

  • Retrieves raw HTML from any webpage.
  • Converts webpage content into clean, formatted Markdown.
  • Includes an automatic retry mechanism with exponential backoff.
  • Supports optional proxy usage and JavaScript rendering via Puppeteer.
  • Intelligent HTML cleaning and formatting, preserving images and links during Markdown conversion.

use cases of Webtools MCP Server?

  1. Extracting raw HTML data for analysis or processing.
  2. Formatting website content into Markdown for documentation or blogging.
  3. Scraping content from JavaScript-heavy websites that require rendering.

FAQ from Webtools MCP Server?

  • How do I install Webtools MCP Server?

You can install it using npx @bschauer/webtools-mcp-server or globally via npm install -g @bschauer/webtools-mcp-server.

  • Does it support JavaScript-heavy webpages?

Yes, it supports JavaScript rendering using Puppeteer, which allows it to fetch and process dynamic content.

  • Is there proxy support?

Yes, you can enable proxy support by setting the appropriate environment variables.

View More