MCP.so
Sign In

Octocrawl MCP Server

@77777R7

Basic information

Category

Other

License

AGPL-3.0

Author

77777R7

About Octocrawl MCP Server

Octocrawl: readable Markdown and checked fields from public web pages, for AI agents, RAG and research. Failures come back with a reason. Self-host with REST, SDK or MCP.

Octocrawl MCP Server config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "Octocrawl": {
      "command": "npx",
      "args": [
        "octocrawl",
        "scrape",
        "https://example.com",
        "--markdown"
      ]
    }
  }
}

Octocrawl MCP Server tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

Fetch the live tool list by running this server in a temporary sandbox using the button above.

Overview

What is Octocrawl?

Octocrawl: readable Markdown and checked fields from public web pages, for AI agents, RAG and research. Failures come back with a reason. Self-host with REST, SDK or MCP.

How to use Octocrawl?

The README includes setup instructions such as npx octocrawl scrape https://example.com --markdown.

Key features of Octocrawl

  • environment variables such as W2L_API_PORT and W2L_TASK_ROOT
  • the data directory .w2l/
  • the internal workspace packages @w2l/* and the checkout's w2l command (npm run w2l)
  • the SDK classes W2L and W2LError
  • the Evidence Record version w2l.evidence/1

Use cases of Octocrawl

  • Connect an MCP-compatible client to this repository's service.
  • Review the README-backed setup before enabling it in production.

Frequently asked questions

1

Where is the source code for Octocrawl?

The source code is linked from the repository URL on this page.

2

Does Octocrawl include a standard MCP config?

If the README contains a parseable MCP configuration block, it is shown in the Config tab.

Comments

More Other MCP servers