MCP Smart Crawler

@loo-y

リポジトリホームページ

基本情報

カテゴリ

ブラウザ自動化

ライセンス

MIT

トランスポート

stdio

作者

loo-y

投稿者

L Erik

MCP Smart Crawler について

MCP Smart Crawler is a Model Context Protocol (MCP) server uses Playwright to crawl web content, extract metadata, and download resources such as videos and images.

MCP Smart Crawler の設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "mcp-smart-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-smart-crawler@latest",
        "--download-folder",
        "C:\\downloads"
      ]
    }
  }
}

MCP Smart Crawler のツール

ツール一覧はまだありません

この掲載には表示できるツール一覧がまだありません。サーバーにツールがないという意味ではありません。対応機能はプロジェクトのドキュメントをご確認ください。

上のボタンで一時的なサンドボックスでこのサーバーを実行し、ツール一覧を取得できます。

概要

What is MCP Smart Crawler?

MCP Smart Crawler is a Model Context Protocol (MCP) server that uses Playwright to crawl web content, extract metadata, and download resources such as videos and images. It is designed for users who need to programmatically retrieve and save content from Xiaohongshu (小红书) share links.

How to use MCP Smart Crawler?

Configure your MCP client with the provided JSON, setting the command to npx and adding optional arguments like --download-folder to specify a local download directory. Then send a chat message containing a Xiaohongshu share link to trigger crawling and downloading.

Key features of MCP Smart Crawler

Extracts metadata (title, description, images) from Xiaohongshu posts.
Downloads videos and images from Xiaohongshu share links.
Uses Playwright for browser automation.
Configurable download folder via command-line argument.

Use cases of MCP Smart Crawler

Automatically fetching and saving Xiaohongshu post images for content aggregation.
Downloading videos from shared Xiaohongshu links for offline viewing.
Extracting metadata from Xiaohongshu posts for analysis or archiving.

よくある質問

What does MCP Smart Crawler do?

It crawls web pages using Playwright, extracts metadata like title and images from Xiaohongshu posts, and downloads associated videos and images.

What dependencies does MCP Smart Crawler require?

It requires Playwright for browser automation, and is run via `npx` (Node.js package runner). No other runtime dependencies are specified.

Where are downloaded files saved?

Files are saved to the local folder specified by the `--download-folder` argument. If not provided, the default behavior is not documented.

Does MCP Smart Crawler support authentication or transport security?

No authentication or transport security mechanisms are mentioned in the README.

Can MCP Smart Crawler work with websites other than Xiaohongshu?

The README only describes functionality for Xiaohongshu share links; no other websites are mentioned.

「ブラウザ自動化」の他のコンテンツ

Browser Control MCP

eyalzh

MCP server paired with a browser extension that enables AI agents to control the user's browser.

299

QuantumProxies — Residential, Mobile & Datacenter Proxy MCP Server

quantumproxies

Give your AI agent its own proxies. QuantumProxies exposes residential, mobile, datacenter, ISP and IPv6 endpoints as MCP tools: list your plans, generate ready-to-use proxy strings with credentials, target by country, s