What is a #robots-txt MCP server?
An MCP server tagged #robots-txt implements the Model Context Protocol so AI assistants like Claude, Cursor, and VS Code can access robots-txt-related tools, data, or APIs.
Every MCP server and client below is tagged #robots-txt — install one to give Claude, Cursor, VS Code, or any other MCP-compatible client access to robots-txt tools.
krissanders
MCP server that audits AI-bot visibility. Reports per-bot robots.txt verdicts for 22 AI user-agents (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.), Cloudflare AI-default flags, on-page schema, sitemap, llms.txt, SPA-shell detection, and cross-model brand mentions via P
BACKLNK
Free technical SEO, AEO, LLMO and GEO checks for AI agents: check a page, fix it, then verify the fix. Evidence for every finding, most important first. Remote MCP server, free API key.
zerhal
Free SEO audit MCP server. Analyze meta tags, headings, broken links, robots.txt, and competitor pages directly from Claude, Cursor, or Windsurf. No API key needed.
Common questions about MCP servers and clients tagged #robots-txt
An MCP server tagged #robots-txt implements the Model Context Protocol so AI assistants like Claude, Cursor, and VS Code can access robots-txt-related tools, data, or APIs.
mcp.so currently lists 3 MCP servers and clients tagged #robots-txt.
Open any server below and copy its install snippet into Claude Desktop, Cursor, VS Code, or another MCP client's configuration — remote servers need no separate download.