MCP Smart Crawler

Name: MCP Smart Crawler
Author: loo-y

@loo-y

关于 MCP Smart Crawler

MCP Smart Crawler is a Model Context Protocol (MCP) server uses Playwright to crawl web content, extract metadata, and download resources such as videos and images.

基本信息

分类

浏览器自动化

许可证

MIT

运行时

node

传输方式

stdio

发布者

loo-y

提交者

L Erik

配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "mcp-smart-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-smart-crawler@latest",
        "--download-folder",
        "C:\\downloads"
      ]
    }
  }
}

工具

未检测到工具

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is MCP Smart Crawler?

MCP Smart Crawler is a Model Context Protocol (MCP) server that uses Playwright to crawl web content, extract metadata, and download resources such as videos and images. It is designed for users who need to programmatically retrieve and save content from Xiaohongshu (小红书) share links.

How to use MCP Smart Crawler?

Configure your MCP client with the provided JSON, setting the command to npx and adding optional arguments like --download-folder to specify a local download directory. Then send a chat message containing a Xiaohongshu share link to trigger crawling and downloading.

Key features of MCP Smart Crawler

Extracts metadata (title, description, images) from Xiaohongshu posts.
Downloads videos and images from Xiaohongshu share links.
Uses Playwright for browser automation.
Configurable download folder via command-line argument.

Use cases of MCP Smart Crawler

Automatically fetching and saving Xiaohongshu post images for content aggregation.
Downloading videos from shared Xiaohongshu links for offline viewing.
Extracting metadata from Xiaohongshu posts for analysis or archiving.