Web Scraper X402

Name: Web Scraper X402
Author: Br0ski777

@Br0ski777

Web Scraper X402 について

Extract clean markdown from any URL. Strips nav/ads/scripts, returns structured content. Built for RAG pipelines and AI research agents. -- x402 micropayment API + MCP server for AI agents

#x402 #mcp #api #web #scraper #data

基本情報

カテゴリ

ブラウザ自動化

ライセンス

MIT

ランタイム

node

トランスポート

stdio

公開者

Br0ski777

投稿者

Br0ski777

設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "web-scraper": {
      "url": "https://web-scraper-x402-production.up.railway.app/mcp",
      "transport": "sse"
    }
  }
}

ツール

GET

POST

概要

What is Web Scraper X402?

Web Scraper X402 is an MCP server that extracts clean markdown from any URL. It strips navigation, ads, scripts, and boilerplate, returning structured content suitable for RAG pipelines and AI research agents. Payment is per-call via the x402 protocol (USDC on Base L2), with no API key, signup, or rate-limit wall.

How to use Web Scraper X402?

Add the MCP server to your client config (e.g., Claude Desktop, Cursor, ElizaOS) using the URL https://web-scraper.api.klymax402.com/mcp. Alternatively, call the HTTP endpoint directly; x402-aware clients handle the payment flow automatically. Two tools are available: web_scrape_to_markdown (single URL, $0.005) and web_scrape_batch (up to 10 URLs, $0.04).

Key features of Web Scraper X402

Pay-per-call via x402 (USDC on Base L2), no API key
Full JavaScript rendering for dynamic pages
Strips navigation, ads, scripts, and boilerplate
Returns clean markdown with structured metadata
Alternative to Firecrawl scrape at 2.5x lower cost
No rate-limit wall or signup required

Use cases of Web Scraper X402

Summarizing articles or documentation pages
Building RAG corpora from web sources
Comparing content across competitor pages
Extracting data as LLM input for research
Bulk extraction of clean content from multiple URLs

FAQ from Web Scraper X402

What is Web Scraper X402 and how does it differ from alternatives?

It extracts clean markdown from any URL using x402 micropayments. It is an alternative to Firecrawl scrape at 2.5x lower cost, with no API key or signup.

Do I need an API key or signup to use Web Scraper X402?

No. Payment is per-call via the x402 protocol. There is no API key, signup, or rate-limit wall.

What are the pricing and payment methods?

A single scrape costs $0.005, and a batch scrape (up to 10 URLs) costs $0.04. Payment is in USDC on Base L2, processed automatically by x402-aware clients.

Are there any usage limits?

There is no rate-limit wall. The batch tool accepts a maximum of 10 URLs per call.

What tools does Web Scraper X402 provide?

Two tools: web_scrape_to_markdown for single URLs and web_scrape_batch for up to 10 URLs at once. Both return structured markdown with metadata.

「ブラウザ自動化」の他のコンテンツ

Fetch MCP

jae-jae

MCP server for fetch web page content using Playwright headless browser.

1.1K

Browser Control MCP

eyalzh

MCP server paired with a browser extension that enables AI agents to control the user's browser.

299

X Twitter Scraper

Xquik-dev

Twitter scraper API skill for tweet search, advanced Twitter search, profile tweets, follower export, media download, monitors, webhooks, MCP, and posting automation: send tweets and replies.

135