広告掲載
MCP.so
ログイン

Web Scraping with Anthropic’s MCP Server

@luminati-io

リポジトリ

基本情報

カテゴリ

ブラウザ自動化

トランスポート

stdio

作者

luminati-io

Web Scraping with Anthropic’s MCP Server について

Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

#mcp#web-scraping#anthropic-claude#scraping-mcp

Web Scraping with Anthropic’s MCP Server の設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "web-scraping-with-mcp": {
      "command": "python",
      "args": [
        "-m",
        "venv",
        "mcp-amazon-scraper"
      ]
    }
  }
}

Web Scraping with Anthropic’s MCP Server のツール

ツール一覧はまだありません

この掲載には表示できるツール一覧がまだありません。サーバーにツールがないという意味ではありません。対応機能はプロジェクトのドキュメントをご確認ください。

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is Web Scraping with Anthropic’s MCP?

Web Scraping with Anthropic’s MCP is a guide that explains how to set up an MCP server for on-demand data extraction, connect it with development tools like Claude Desktop or Cursor, and optionally leverage Bright Data for professional web information. It is intended for developers who want to enable LLMs to interact with real-world websites in a standardized, secure way.

How to use Web Scraping with Anthropic’s MCP?

The guide walks through creating a Python MCP server using the MCP Python SDK, Playwright, and lxml. You install dependencies (mcp, playwright, lxml), write a server file that exposes tools like fetch_page and extract_info, then connect the server to an MCP host (e.g., Claude Desktop or Cursor IDE) via stdio transport. The server can then be invoked by natural‑language prompts such as “Fetch product info from this Amazon link.”

Key features of Web Scraping with Anthropic’s MCP

  • Standardizes LLM interaction with external tools via JSON‑RPC
  • Enables real‑time web data extraction without custom integrations
  • Uses Playwright to render JavaScript‑heavy pages
  • Exposes two tools: fetch_page (download HTML) and extract_info (parse structured data)
  • Works with multiple MCP hosts (Claude Desktop, Cursor, etc.)

Use cases of Web Scraping with Anthropic’s MCP

  • Extracting structured Amazon product details (price, title, specs) via an LLM
  • Providing LLMs with up‑to‑date information from live websites
  • Building a custom scraper that integrates with AI assistants for on‑demand research
  • Enabling automated web data retrieval in development workflows (e.g., IDE plugins)

よくある質問

1

Why can’t LLMs browse the web without MCP?

LLMs lack built‑in capabilities to access local files, execute scripts, or retrieve current website data. MCP bridges this gap by letting them call external tools.

2

What is the Model Context Protocol (MCP)?

MCP is an open standard by Anthropic that defines a uniform interface for LLMs to interact with external tools and data sources using JSON‑RPC 2.0 over transports like stdio.

3

What dependencies does the custom MCP server require?

Python 3, the MCP Python SDK (`mcp`), Playwright (`playwright`), and lxml (`lxml`). Playwright browser binaries must also be installed.

4

What transport does the server use?

The server communicates via stdio (standard input/output) as shown in the example configuration for Claude Desktop.

5

Does the server require authentication or API keys?

The README does not mention any authentication. The custom server runs locally and uses Playwright’s headless browser; no external API keys are required.

コメント

「ブラウザ自動化」の他のコンテンツ

Scrapling Fetch MCP

cyberchitta

Helps AI assistants access text content from bot-protected websites. MCP server that fetches HTML/markdown from sites with anti-automation measures using Scrapling.

101

Nullprint

nullprintai

Let Claude Code, Claude Desktop, OpenAI Codex, Kimi and any MCP-capable AI agent create, launch, check and drive browser profiles in Nullprint, the AI antidetect browser. Install with one command.

QuantumProxies — Residential, Mobile & Datacenter Proxy MCP Server

quantumproxies

Give your AI agent its own proxies. QuantumProxies exposes residential, mobile, datacenter, ISP and IPv6 endpoints as MCP tools: list your plans, generate ready-to-use proxy strings with credentials, target by country, s

C

Chrome DevTools for agents

ChromeDevTools

Official Chrome DevTools MCP server from Google that lets coding agents control, debug and profile a live Chrome browser.

53.6K

TinyFish

tinyfish

Give your AI agent the live web. One MCP server for Search, Fetch, Browser, and Agent: browse real sites, extract structured data, fill forms, and run multi-step workflows. Search and Fetch are free.

3
広告掲載