MCP LLMS.txt Explorer

@thedaviddias

Repository Homepage

Basic information

About MCP LLMS.txt Explorer

MCP to explore websites with llms.txt files

#mcp #cursor#llmstxt#llms-txt #mcp-server

MCP LLMS.txt Explorer config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "mcp-llms-txt-explorer": {
      "command": "npx",
      "args": [
        "-y",
        "@smithery/cli",
        "install",
        "@thedaviddias/mcp-llms-txt-explorer",
        "--client",
        "claude"
      ]
    }
  }
}

MCP LLMS.txt Explorer tools

Check if a website has llms.txt files

List known websites with llms.txt files

Overview

What is MCP LLMS.txt Explorer?

A Model Context Protocol server for exploring websites that implement the llms.txt standard. It helps discover and analyze websites with llms.txt and llms-full.txt files.

How to use MCP LLMS.txt Explorer?

Install via Smithery (npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude) or manually (clone, pnpm install, pnpm run build). Configure in Claude Desktop’s JSON config. Use the tools check_website (domain URL → file locations and validation status) and list_websites (returns structured data, filterable by file type).

Key features of MCP LLMS.txt Explorer?

Checks websites for llms.txt and llms-full.txt files
Parses and validates llms.txt file contents
Accesses structured data about compliant websites
Provides check_website and list_websites tools
Supports filtering by file type (llms.txt / llms-full.txt)

Use cases of MCP LLMS.txt Explorer?

Discover websites that follow the llms.txt standard
Verify a domain’s llms.txt file presence and validity
Browse a curated list of llms.txt‑compliant websites
Integrate llms.txt detection into AI‑powered research workflows

Frequently asked questions

What dependencies are required?

Node.js and pnpm (for building). The server communicates over stdio.

How do I configure it for Claude Desktop?

Add a `llms-txt-explorer` entry to the Claude Desktop config file (MacOS: `~/Library/Application Support/Claude/claude_desktop_config.json`; Windows: `%APPDATA%/Claude/claude_desktop_config.json`), specifying the command (`node` with path to build or `npx -y @thedaviddias/mcp-llms-txt-explorer`).

How can I debug the server?

Use the MCP Inspector by running `pnpm run inspector` from the project directory.

Can I install it automatically?

Yes, via Smithery: `npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude`.

What license is this server under?

MIT License.

Comments

More Other MCP servers

Hindsight

vectorize-io

Hindsight: Agent Memory That Learns

50.4K

The Living Bread

A free remote MCP server for The Living Bread. Bible passages read word for word from a stored public domain text with an evidence label, keyword search and cross references, real churches, gatherings and prayer groups w

EverArt

modelcontextprotocol

Model Context Protocol Servers

88.1K

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K

Yuppsy

Yuppsy MCP: build and publish real estate websites from your AI assistant. Yuppsy lets your AI assistant create live websites for real estate agents and individual property listings. You don't need a designer or any code