MCP.so
ログイン

MCP Smart Crawler

@loo-y

リポジトリホームページ

MCP Smart Crawler について

MCP Smart Crawler is a Model Context Protocol (MCP) server uses Playwright to crawl web content, extract metadata, and download resources such as videos and images.

基本情報

カテゴリ

ブラウザ自動化

ライセンス

MIT

ランタイム

node

トランスポート

stdio

公開者

loo-y

投稿者

L Erik

設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "mcp-smart-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-smart-crawler@latest",
        "--download-folder",
        "C:\\downloads"
      ]
    }
  }
}

ツール

ツールは検出されませんでした

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is MCP Smart Crawler?

MCP Smart Crawler is a Model Context Protocol (MCP) server that uses Playwright to crawl web content, extract metadata, and download resources such as videos and images. It is designed for users who need to programmatically retrieve and save content from Xiaohongshu (小红书) share links.

How to use MCP Smart Crawler?

Configure your MCP client with the provided JSON, setting the command to npx and adding optional arguments like --download-folder to specify a local download directory. Then send a chat message containing a Xiaohongshu share link to trigger crawling and downloading.

Key features of MCP Smart Crawler

  • Extracts metadata (title, description, images) from Xiaohongshu posts.
  • Downloads videos and images from Xiaohongshu share links.
  • Uses Playwright for browser automation.
  • Configurable download folder via command-line argument.

Use cases of MCP Smart Crawler

  • Automatically fetching and saving Xiaohongshu post images for content aggregation.
  • Downloading videos from shared Xiaohongshu links for offline viewing.
  • Extracting metadata from Xiaohongshu posts for analysis or archiving.

FAQ from MCP Smart Crawler

What does MCP Smart Crawler do?

It crawls web pages using Playwright, extracts metadata like title and images from Xiaohongshu posts, and downloads associated videos and images.

What dependencies does MCP Smart Crawler require?

It requires Playwright for browser automation, and is run via npx (Node.js package runner). No other runtime dependencies are specified.

Where are downloaded files saved?

Files are saved to the local folder specified by the --download-folder argument. If not provided, the default behavior is not documented.

Does MCP Smart Crawler support authentication or transport security?

No authentication or transport security mechanisms are mentioned in the README.

Can MCP Smart Crawler work with websites other than Xiaohongshu?

The README only describes functionality for Xiaohongshu share links; no other websites are mentioned.

コメント

「ブラウザ自動化」の他のコンテンツ

Fetch MCP Server

zcaceres

A flexible HTTP fetching Model Context Protocol server.

797

Fetcher MCP

jae-jae

MCP server for fetch web page content using Playwright headless browser.

1.1K

Fastcrw

us

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary.

286

X Twitter Scraper

Xquik-dev

Twitter scraper API skill for tweet search, advanced Twitter search, profile tweets, follower export, media download, monitors, webhooks, MCP, and posting automation: send tweets and replies.

135

browser-mcp

djyde

A browser extension and MCP server that allows you to interact with the browser you are using.

83