Mcp_web_scrapper

Name: Mcp_web_scrapper
Author: Neche-Stephen

@Neche-Stephen

代码仓库

关于 Mcp_web_scrapper

A web scrapper to scrap mcp web servers from glama.ai

基本信息

分类

其他

运行时

node

传输方式

stdio

发布者

Neche-Stephen

配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "mcp_web_scrapper": {
      "command": "node",
      "args": [
        "scraper.js"
      ]
    }
  }
}

工具

未检测到工具

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is Mcp_web_scrapper?

Mcp_web_scrapper is a Node.js tool that scrapes and extracts MCP web server listings from glama.ai. It is intended for developers who want to collect a directory of available MCP servers.

How to use Mcp_web_scrapper?

Clone the repository, run npm install, then execute node scraper.js to collect server links, followed by node process-links.js to extract detailed data. Delete the servers-json folder if a fresh scrape is needed.

Key features of Mcp_web_scrapper

Scrapes MCP server links from glama.ai
Extracts detailed server information from each link
Uses a headless browser for data collection
Saves output as JSON files in a dedicated folder
Provides terminal progress during processing

Use cases of Mcp_web_scrapper

Building a local directory of MCP servers
Analyzing the MCP server ecosystem from glama.ai
Automating the discovery of new MCP servers
Creating a backup of server listings for offline use

FAQ from Mcp_web_scrapper

What does Mcp_web_scrapper do?

It scrapes and extracts MCP web servers from the glama.ai website, first collecting all server links and then fetching detailed data from each link.

How do I install Mcp_web_scrapper?

Clone the repository and run npm install to install dependencies. You need Node.js and npm.

How do I run a fresh scrape?

Delete the servers-json folder if it exists from a previous run, then execute node scraper.js followed by node process-links.js.

What files are generated?

A file named server-links.json is created in a servers-json folder. After processing, detailed data files named after each MCP server are stored in the same folder.