Web Scraper X402

Name: Web Scraper X402
Author: Br0ski777

@Br0ski777

关于 Web Scraper X402

Extract clean markdown from any URL. Strips nav/ads/scripts, returns structured content. Built for RAG pipelines and AI research agents. -- x402 micropayment API + MCP server for AI agents

#x402 #mcp #api #web #scraper #data

基本信息

分类

浏览器自动化

许可证

MIT

运行时

node

传输方式

stdio

发布者

Br0ski777

提交者

Br0ski777

配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "web-scraper": {
      "url": "https://web-scraper-x402-production.up.railway.app/mcp",
      "transport": "sse"
    }
  }
}

工具

GET

POST

概览

What is Web Scraper X402?

Web Scraper X402 is an MCP server that extracts clean markdown from any URL. It strips navigation, ads, scripts, and boilerplate, returning structured content suitable for RAG pipelines and AI research agents. Payment is per-call via the x402 protocol (USDC on Base L2), with no API key, signup, or rate-limit wall.

How to use Web Scraper X402?

Add the MCP server to your client config (e.g., Claude Desktop, Cursor, ElizaOS) using the URL https://web-scraper.api.klymax402.com/mcp. Alternatively, call the HTTP endpoint directly; x402-aware clients handle the payment flow automatically. Two tools are available: web_scrape_to_markdown (single URL, $0.005) and web_scrape_batch (up to 10 URLs, $0.04).

Key features of Web Scraper X402

Pay-per-call via x402 (USDC on Base L2), no API key
Full JavaScript rendering for dynamic pages
Strips navigation, ads, scripts, and boilerplate
Returns clean markdown with structured metadata
Alternative to Firecrawl scrape at 2.5x lower cost
No rate-limit wall or signup required

Use cases of Web Scraper X402

Summarizing articles or documentation pages
Building RAG corpora from web sources
Comparing content across competitor pages
Extracting data as LLM input for research
Bulk extraction of clean content from multiple URLs

FAQ from Web Scraper X402

What is Web Scraper X402 and how does it differ from alternatives?

It extracts clean markdown from any URL using x402 micropayments. It is an alternative to Firecrawl scrape at 2.5x lower cost, with no API key or signup.

Do I need an API key or signup to use Web Scraper X402?

No. Payment is per-call via the x402 protocol. There is no API key, signup, or rate-limit wall.

What are the pricing and payment methods?

A single scrape costs $0.005, and a batch scrape (up to 10 URLs) costs $0.04. Payment is in USDC on Base L2, processed automatically by x402-aware clients.

Are there any usage limits?

There is no rate-limit wall. The batch tool accepts a maximum of 10 URLs per call.

What tools does Web Scraper X402 provide?

Two tools: web_scrape_to_markdown for single URLs and web_scrape_batch for up to 10 URLs at once. Both return structured markdown with metadata.

浏览器自动化分类下的更多 MCP 服务器

Scrapling Fetch MCP

cyberchitta

Helps AI assistants access text content from bot-protected websites. MCP server that fetches HTML/markdown from sites with anti-automation measures using Scrapling.

101