Advertise
MCP.so
Sign In

MCP Autotest

@strowk

Repository

Basic information

Category

Other

License

MIT

Transports

stdio

Author

strowk

About MCP Autotest

Utility for autotesting MCP servers

MCP Autotest config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "mcp-autotest": {
      "command": "npx",
      "args": [
        "mcp-autotest",
        "run",
        "testdata",
        "--",
        "npx",
        "-y",
        "@modelcontextprotocol/server-postgres",
        "localhost:5432"
      ]
    }
  }
}

MCP Autotest tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

Fetch the live tool list by running this server in a temporary sandbox using the button above.

Overview

What is Mcp Autotest?

Mcp Autotest is a simple tool for testing MCP servers in a language-agnostic way. It uses MCP protocol by defining YAML files with requests and expected responses.

How to use Mcp Autotest?

Install via npm (npm install -g mcp-autotest), download prebuilt binaries from GitHub Releases, or build from source with Go. Run mcp-autotest [flags] run path/to/tests/folder [--] command-to-run-server [server-args]. Test case files must be multi-document YAML with _test.yaml suffix. By default stdio transport is used; for Streamable HTTP (POST only) add --url http://host:port/path.

Key features of Mcp Autotest

  • Language-agnostic MCP server testing via YAML definitions
  • Supports both stdio and Streamable HTTP transports
  • Dynamic matching with !!re tag for regular expressions
  • Embedded regex (!!ere) for partial string matching
  • Escaping forward slashes in embedded regex strings

Use cases of Mcp Autotest

  • Validate an MCP server’s responses against expected JSON-RPC messages
  • Automate regression testing for MCP server implementations
  • Test servers across different languages without writing test code
  • Verify dynamic responses (timestamps, UUIDs) using regex matching

Frequently asked questions

1

How do I install Mcp Autotest?

Install globally via npm (`npm install -g mcp-autotest`), download a prebuilt binary from GitHub Releases, or build from source with `go install github.com/strowk/mcp-autotest@latest`.

2

What file naming convention is required for test cases?

Test case files must end with `_test.yaml` to be recognized.

3

Can I test an MCP server running over HTTP?

Yes, use the `--url` flag to specify the server URL. Only the `POST` method is currently supported for Streamable HTTP; `GET` support is planned.

4

How do I match dynamic values like timestamps in responses?

Use the `!!re` tag to treat a string as a regular expression for full match, or `!!ere` for embedded regex (parts between slashes `/` are treated as regex).

5

What transports does Mcp Autotest support?

It supports stdio transport by default and Streamable HTTP (via the `--url` flag). Only HTTP POST is implemented at this time.

Comments

More Other MCP servers

MaxKB

1Panel-dev

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

22.0K

Screenpipe

screenpipe

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

22.0K

Volley.sh

Volley

A good sequence diagram can solve almost any communication problem in engineering. Volley lets your agent write them as plain text, with the real request and response payloads on every arrow. It checks its own syntax wi

DeepMark

DeepMark helps teachers deliver rapid, consistent marking with meaningful feedback for every student — in a fraction of the time. What once took a week, now takes one free period.

Handl

Handl speaks the Model Context Protocol. Your whole billing operation — projects, invoices, clients, reports, approvals — as tools any AI assistant can call, inside your autonomy rules.

Advertise