ScrAPI MCP Server

@DevEnterpriseSoftware

代码仓库主页

关于 ScrAPI MCP Server

MCP server for using ScrAPI to scrape web pages.

#ai #mcp #webscraper #web-scraping #scraper-api #mcp-server

基本信息

分类

其他

许可证

MIT

运行时

node

传输方式

stdio

发布者

DevEnterpriseSoftware

配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "scrapi-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@deventerprisesoftware/scrapi-mcp"
      ]
    }
  }
}

工具

未检测到工具

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is ScrAPI MCP Server?

ScrAPI MCP Server lets MCP-compatible clients scrape web pages through ScrAPI, a service that handles real browser sessions, CAPTCHA solving, residential proxies, cookie banners, JavaScript rendering, geolocation-aware fetching, and pre-scrape browser actions. It is for developers who need to extract data from pages that require advanced browser automation.

How to use ScrAPI MCP Server?

Install via npx, Docker, or Smithery, and set the SCRAPI_API_KEY environment variable. Use the provided tools scrape_url_html and scrape_url_markdown with a target URL and optional browser commands. Configure your MCP client (e.g., Claude Desktop, Cursor, VS Code) with stdio or Streamable HTTP transport.

Key features of ScrAPI MCP Server

Scrape any valid https:// or http:// URL through ScrAPI.
Return results as raw HTML or readable Markdown.
Execute browser commands (clicking, scrolling) before scraping.
Supports stdio transport for desktop clients.
Supports Streamable HTTP transport for remote clients.
Run with npx, Docker, Smithery, or from source.

Use cases of ScrAPI MCP Server

Extract article text or product copy for LLM analysis.
Retrieve page structure with links, tables, and metadata.
Scrape content from sites requiring CAPTCHA or residential proxies.
Automate data collection from JavaScript-rendered pages.
Enable AI coding assistants to fetch and analyze web content.

FAQ from ScrAPI MCP Server

What tools does the server provide?

It provides scrape_url_html (returns HTML) and scrape_url_markdown (returns Markdown). Both accept a URL and optional browser commands.

Do I need an API key?

Yes, SCRAPI_API_KEY is required. Without one, ScrAPI allows limited free usage on certain domains with lower concurrency and queueing priority.

How do I set the transport?

By default it uses stdio. Set TRANSPORT=http to use Streamable HTTP over a configurable port (default 5000).

What are the runtime requirements?

Node.js 18+ for npx or local development, Docker for containers, and an MCP-compatible client (e.g., Claude Desktop).

Where does the data go?

The server sends requests to ScrAPI's upstream API. Responses are returned directly to the MCP client. No local data storage is mentioned.

评论

其他分类下的更多 MCP 服务器

Core Philosophy: Connect, Unify, Respond

Delegate anything. It comes back done.

ICSS

不止于 CSS

Servers

modelcontextprotocol

Model Context Protocol Servers

IDA Pro MCP

AI-powered reverse engineering assistant that bridges IDA Pro with language models through MCP.

Maestro

Painless E2E Automation for Mobile and Web