@opcastil11
Basic information
Open-source benchmark runner for the Prowl Agent Discovery Network
Add this server to your MCP-compatible client using the configuration below.
{
"mcpServers": {
"prowl-bench": {
"command": "python",
"args": [
"-m",
"venv",
".venv",
"&&",
"source",
".venv/bin/activate"
]
}
}
}Tool list not available yet
This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.
We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.
Prowl is an open-source benchmark runner that evaluates any API across 8 dimensions of agent-readiness using multi-LLM scoring. It measures how easily AI agents can discover, understand, and use an API, targeting developers who want to optimize their APIs for the agent economy.
Install via pip install prowl-bench, set at least one LLM API key (Anthropic, OpenAI, or Google), then run prowl-bench run <url>. Optionally specify a template, credentials, output format (JSON), or a minimum score for CI. Prowl also provides a Python API for programmatic use.
--min-score flagTraditional tools measure uptime and response time; Prowl measures whether an AI agent can actually use the API across dimensions like token efficiency, first‑try success, error clarity, and response parseability.
Prowl requires Python 3.10+ and no system dependencies. You need at least one LLM API key (Anthropic, OpenAI, or Google) for scoring; more keys produce more balanced results.
Prowl sends extracted API spec data and test results to the configured LLM providers for scoring. Execution phase HTTP requests go through a sandbox that blocks SSRF and prompt injection. No data is shared with Prowl unless you explicitly use the `--submit` or `--vendor-submit` flags.
Each available LLM (Claude, GPT-4o, Gemini) independently scores all 8 dimensions. Scores are then averaged to reduce single-model bias. The JSON output includes per-model breakdowns.
Six templates are auto-detected from service metadata: `api_benchmark`, `platform_profile`, `mcp_compliance`, `docs_quality`, `defi_yield`, and `crypto_app`. You can also force a template with the `--template` flag.
DeepMark helps teachers deliver rapid, consistent marking with meaningful feedback for every student — in a fraction of the time. What once took a week, now takes one free period.
Hindsight: Agent Memory That Learns
Painless E2E Automation for Mobile and Web
Soar Flight Booking MCP is a remote MCP server available at https://mcp.soar.flights.
Handl speaks the Model Context Protocol. Your whole billing operation — projects, invoices, clients, reports, approvals — as tools any AI assistant can call, inside your autonomy rules.
Comments