MCP.so
登录

OpenMark MCP Server已验证已精选

@OpenMark AI

基本信息

传输方式

Streamable HTTP

认证方式

API Key

分类

开发工具

作者

OpenMark AI

提交者

Marc Kean Paker

关于 OpenMark MCP Server

OpenMark is a remote MCP server available at https://openmark.ai. Benchmark your own prompt on 100+ models with real API calls.

连接信息

https://openmark.ai/mcp

接入方式

claude mcp add openmark --transport http https://openmark.ai/mcp --header "Authorization: Bearer om_YOUR_KEY"

OpenMark MCP Server 工具

9

How to write an OpenMark task: the YAML structure, all 18 scoring modes, and tips. Call this before writing a task. Pass a topic for the full detail on one subject (the app's Task Guide): fields, scoring, composite, chaining, documents, examples, best_practices, or a scoring mode name.

Check a task YAML the way OpenMark will before running it: structure, scoring settings, and the test limit of the user's plan. Free, saves nothing. Returns the problems to fix and warnings worth a look.

Current OpenMark model ids with list prices ($ per 1M tokens), as text and as a structured list. Use these ids in run_benchmark. Append @low, @medium or @high to a reasoning model id to set its reasoning effort.

Get an upload_uid and a one-hour upload link (no API key needed) for images, PDFs or text documents, with the exact curl command. Upload the files, reference them by file name in each test's attachments list, then pass the upload_uid to estimate_cost / run_benchmark.

Credits a run_benchmark call would use, before spending anything: the expected total, the split per model, the balance needed to start, the worst case, and the user's balance. Same inputs and run settings as run_benchmark. Use it to drop an expensive model, or to compare settings (e.g. max_tokens), before running.

Save a task (YAML, see get_task_format) to the user's OpenMark account and run it on the given models with real API calls. Returns a job_id and the expected cost; poll get_results. Spends the user's credits; pass max_credits to only start within a budget. Optional run settings match the app's Configure & Run panel (preset, stability_runs, max_tokens, temperature_discovery, temp_preference, timeout_profile, custom_timeout, fail_fast).

Status of a benchmark job, and once completed the ranked results (score, stability, cost per run, latency), the tests each model missed with its answer, a recommendation for the chosen objective and quick picks for the others.

The user's plan, credit balance and limits, and what a credit pack, Pro or Expert would unlock. Use it before large runs, or when a run is refused for credits or limits.

Watch the task of a completed job: when new or cheaper models ship, OpenMark re-tests up to 4 of them next to the user's pick and emails the user only when one beats it. Each check uses the user's credits at the normal rate.

概览

What is OpenMark

OpenMark benchmarks the prompt in your code on 100+ models with real API calls and deterministic scoring, then choose the winner by accuracy, cost, speed, or any mix of those.

Website: http://www.openmark.ai

Tools

  • get_task_format: write a fair test from your real prompt
  • list_models: current model ids and prices
  • run_benchmark: run the test on the models you pick
  • get_results: score, stability, cost, and latency
  • watch_task: get an email when a new model beats the winner

Connect

Create a key at https://openmark.ai/ui (account menu, API keys). New accounts start with 50 credits. Setup guide: https://openmark.ai/mcp

Cursor (~/.cursor/mcp.json):

{ "mcpServers": { "openmark": { "url": "https://openmark.ai/mcp", "headers": { "Authorization": "Bearer om_YOUR_KEY" } } } }

Claude Code:

claude mcp add --transport http openmark https://openmark.ai/mcp --header "Authorization: Bearer om_YOUR_KEY"

It is getting constantly updated, so check the project page for more up to date information !

常见问题

1

OpenMark 远程 MCP 服务器是什么?

OpenMark 的远程 MCP 服务器是一个托管的 Model Context Protocol 端点,地址是 https://openmark.ai/mcp,AI 助手无需在本地安装或运行任何东西即可连接。

2

怎么连接 OpenMark 的 MCP 服务器?

把端点 https://openmark.ai/mcp 添加到任意支持 MCP 的客户端,比如 Claude Code、Cursor 或 VS Code。本页的接入代码块可以一步配置好每个客户端。

3

OpenMark 的 MCP 服务器需要认证吗?

需要。OpenMark 需要一个 API key——具体获取方式请查看官方文档,拿到后填进客户端配置里即可。

4

OpenMark 的 MCP 服务器用的是哪种传输方式?

OpenMark 暴露的是 Streamable HTTP 端点,这是远程 MCP 服务器普遍使用、主流客户端都支持的传输方式。

评论