MCP LLMS.txt Explorer

What is MCP LLMS.txt Explorer?

A Model Context Protocol server for exploring websites that implement the llms.txt standard. It helps discover and analyze websites with llms.txt and llms-full.txt files.

How to use MCP LLMS.txt Explorer?

Install via Smithery (npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude) or manually (clone, pnpm install, pnpm run build). Configure in Claude Desktop’s JSON config. Use the tools check_website (domain URL → file locations and validation status) and list_websites (returns structured data, filterable by file type).

Key features of MCP LLMS.txt Explorer?

• Checks websites for llms.txt and llms-full.txt files
• Parses and validates llms.txt file contents
• Accesses structured data about compliant websites
• Provides check_website and list_websites tools
• Supports filtering by file type (llms.txt / llms-full.txt)

Use cases of MCP LLMS.txt Explorer?

• Discover websites that follow the llms.txt standard
• Verify a domain’s llms.txt file presence and validity
• Browse a curated list of llms.txt‑compliant websites
• Integrate llms.txt detection into AI‑powered research workflows

FAQ from MCP LLMS.txt Explorer

What dependencies are required?

Node.js and pnpm (for building). The server communicates over stdio.

How do I configure it for Claude Desktop?

Add a llms-txt-explorer entry to the Claude Desktop config file (MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json; Windows: %APPDATA%/Claude/claude_desktop_config.json), specifying the command (node with path to build or npx -y @thedaviddias/mcp-llms-txt-explorer).

How can I debug the server?

Use the MCP Inspector by running pnpm run inspector from the project directory.

Can I install it automatically?

Yes, via Smithery: npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude.

What license is this server under?

MIT License.