广告合作
MCP.so
登录

MCP Smart Crawler

@loo-y

代码仓库主页

基本信息

分类

浏览器自动化

许可证

MIT

传输方式

stdio

作者

loo-y

提交者

L Erik

关于 MCP Smart Crawler

MCP Smart Crawler is a Model Context Protocol (MCP) server uses Playwright to crawl web content, extract metadata, and download resources such as videos and images.

MCP Smart Crawler 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "mcp-smart-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-smart-crawler@latest",
        "--download-folder",
        "C:\\downloads"
      ]
    }
  }
}

MCP Smart Crawler 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。

点击上方按钮,在临时沙箱中运行此服务器并实时获取工具列表。

概览

What is MCP Smart Crawler?

MCP Smart Crawler is a Model Context Protocol (MCP) server that uses Playwright to crawl web content, extract metadata, and download resources such as videos and images. It is designed for users who need to programmatically retrieve and save content from Xiaohongshu (小红书) share links.

How to use MCP Smart Crawler?

Configure your MCP client with the provided JSON, setting the command to npx and adding optional arguments like --download-folder to specify a local download directory. Then send a chat message containing a Xiaohongshu share link to trigger crawling and downloading.

Key features of MCP Smart Crawler

  • Extracts metadata (title, description, images) from Xiaohongshu posts.
  • Downloads videos and images from Xiaohongshu share links.
  • Uses Playwright for browser automation.
  • Configurable download folder via command-line argument.

Use cases of MCP Smart Crawler

  • Automatically fetching and saving Xiaohongshu post images for content aggregation.
  • Downloading videos from shared Xiaohongshu links for offline viewing.
  • Extracting metadata from Xiaohongshu posts for analysis or archiving.

常见问题

1

What does MCP Smart Crawler do?

It crawls web pages using Playwright, extracts metadata like title and images from Xiaohongshu posts, and downloads associated videos and images.

2

What dependencies does MCP Smart Crawler require?

It requires Playwright for browser automation, and is run via `npx` (Node.js package runner). No other runtime dependencies are specified.

3

Where are downloaded files saved?

Files are saved to the local folder specified by the `--download-folder` argument. If not provided, the default behavior is not documented.

4

Does MCP Smart Crawler support authentication or transport security?

No authentication or transport security mechanisms are mentioned in the README.

5

Can MCP Smart Crawler work with websites other than Xiaohongshu?

The README only describes functionality for Xiaohongshu share links; no other websites are mentioned.

评论

浏览器自动化 分类下的更多 MCP 服务器

Browser Control MCP

eyalzh

MCP server paired with a browser extension that enables AI agents to control the user's browser.

299

Puppeteer MCP Server

merajmehrabi

This MCP server provides browser automation capabilities through Puppeteer, allowing interaction with both new browser instances and existing Chrome windows.

474

BitBrowser MCP service

BitBrowser01

BitBrowser MCP simple to use, no complicated procedures required. Supports a variety of intelligent agent services.

HTML/CSS to Image

An MCP server for generating images from HTML & CSS or screenshots of URLs using htmlcsstoimage.com.

Parse

Parse.bot

Parse allows your agent to access thousands of APIs instantly. You can use Parse to build an API for any action on any website and edit any previously existing API in our catalogue.

广告合作