Advertise
MCP.so
Sign In

MCP Web Scrapper

@Neche-Stephen

Repository

Basic information

Category

Other

Transports

stdio

Author

Neche-Stephen

About MCP Web Scrapper

A web scrapper to scrap mcp web servers from glama.ai

MCP Web Scrapper config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "mcp_web_scrapper": {
      "command": "node",
      "args": [
        "scraper.js"
      ]
    }
  }
}

MCP Web Scrapper tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Mcp_web_scrapper?

Mcp_web_scrapper is a Node.js tool that scrapes and extracts MCP web server listings from glama.ai. It is intended for developers who want to collect a directory of available MCP servers.

How to use Mcp_web_scrapper?

Clone the repository, run npm install, then execute node scraper.js to collect server links, followed by node process-links.js to extract detailed data. Delete the servers-json folder if a fresh scrape is needed.

Key features of Mcp_web_scrapper

  • Scrapes MCP server links from glama.ai
  • Extracts detailed server information from each link
  • Uses a headless browser for data collection
  • Saves output as JSON files in a dedicated folder
  • Provides terminal progress during processing

Use cases of Mcp_web_scrapper

  • Building a local directory of MCP servers
  • Analyzing the MCP server ecosystem from glama.ai
  • Automating the discovery of new MCP servers
  • Creating a backup of server listings for offline use

Frequently asked questions

1

What does Mcp_web_scrapper do?

It scrapes and extracts MCP web servers from the glama.ai website, first collecting all server links and then fetching detailed data from each link.

2

How do I install Mcp_web_scrapper?

Clone the repository and run `npm install` to install dependencies. You need Node.js and npm.

3

How do I run a fresh scrape?

Delete the `servers-json` folder if it exists from a previous run, then execute `node scraper.js` followed by `node process-links.js`.

4

What files are generated?

A file named `server-links.json` is created in a `servers-json` folder. After processing, detailed data files named after each MCP server are stored in the same folder.

5

How long does scraping take?

The process may take a few minutes. Wait for the “Closing browser” message before terminating.

Comments

More Other MCP servers

Figs, Relationship Expert

Figs O'Sullivan, LMFT

Couples therapist Figs O'Sullivan (LMFT, 17 years, endorsed by Sue Johnson, creator of EFT) inside your AI. Ask relationship questions answered from his clinical writing, name the pattern in a fight, get a three-step rep

P

PickFu MCP

PickFu MCP is a Model Context Protocol (MCP) server that connects AI assistants, developers, marketers, product managers, and AI agents to PickFu's consumer research platform. It enables users to create surveys, conduct

Hindsight

vectorize-io

Hindsight: Agent Memory That Learns

50.4K

FastMCP v2 🚀

jlowin

🚀 The fast, Pythonic way to build MCP servers and clients.

26.0K

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K
Advertise