MCP Autotest

@strowk

代码仓库

基本信息

分类

其他

许可证

MIT

传输方式

stdio

作者

strowk

关于 MCP Autotest

Utility for autotesting MCP servers

MCP Autotest 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "mcp-autotest": {
      "command": "npx",
      "args": [
        "mcp-autotest",
        "run",
        "testdata",
        "--",
        "npx",
        "-y",
        "@modelcontextprotocol/server-postgres",
        "localhost:5432"
      ]
    }
  }
}

MCP Autotest 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。

点击上方按钮,在临时沙箱中运行此服务器并实时获取工具列表。

概览

What is Mcp Autotest?

Mcp Autotest is a simple tool for testing MCP servers in a language-agnostic way. It uses MCP protocol by defining YAML files with requests and expected responses.

How to use Mcp Autotest?

Install via npm (npm install -g mcp-autotest), download prebuilt binaries from GitHub Releases, or build from source with Go. Run mcp-autotest [flags] run path/to/tests/folder [--] command-to-run-server [server-args]. Test case files must be multi-document YAML with _test.yaml suffix. By default stdio transport is used; for Streamable HTTP (POST only) add --url http://host:port/path.

Key features of Mcp Autotest

Language-agnostic MCP server testing via YAML definitions
Supports both stdio and Streamable HTTP transports
Dynamic matching with !!re tag for regular expressions
Embedded regex (!!ere) for partial string matching
Escaping forward slashes in embedded regex strings

Use cases of Mcp Autotest

Validate an MCP server’s responses against expected JSON-RPC messages
Automate regression testing for MCP server implementations
Test servers across different languages without writing test code
Verify dynamic responses (timestamps, UUIDs) using regex matching

常见问题

How do I install Mcp Autotest?

Install globally via npm (`npm install -g mcp-autotest`), download a prebuilt binary from GitHub Releases, or build from source with `go install github.com/strowk/mcp-autotest@latest`.

What file naming convention is required for test cases?

Test case files must end with `_test.yaml` to be recognized.

Can I test an MCP server running over HTTP?

Yes, use the `--url` flag to specify the server URL. Only the `POST` method is currently supported for Streamable HTTP; `GET` support is planned.

How do I match dynamic values like timestamps in responses?

Use the `!!re` tag to treat a string as a regular expression for full match, or `!!ere` for embedded regex (parts between slashes `/` are treated as regex).

What transports does Mcp Autotest support?

It supports stdio transport by default and Streamable HTTP (via the `--url` flag). Only HTTP POST is implemented at this time.

其他分类下的更多 MCP 服务器

Lemon.io

lemon-io

Request dedicated senior developers to work on your project, write job descriptions, and prep technical interviews — all without leaving your Claude chat. Just describe what you need, and Lemon.io MCP does the rest. 1–3

Sequential Thinking

modelcontextprotocol

Model Context Protocol Servers

88.2K

Handl

Handl speaks the Model Context Protocol. Your whole billing operation — projects, invoices, clients, reports, approvals — as tools any AI assistant can call, inside your autonomy rules.