广告合作
MCP.so
登录

Root Signals MCP Server

@root-signals

代码仓库主页

基本信息

分类

其他

传输方式

stdio

作者

root-signals

关于 Root Signals MCP Server

MCP for Scorable Evaluation Platform

#evals#llm-as-a-judge

Root Signals MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "root-signals-mcp": {
      "command": "docker",
      "args": [
        "run",
        "-e",
        "SCORABLE_API_KEY=<your_key>",
        "-p",
        "0.0.0.0:9090:9090",
        "--name=rs-mcp",
        "-d",
        "ghcr.io/scorable/scorable-mcp:latest"
      ]
    }
  }
}

Root Signals MCP Server 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is Scorable MCP?

Scorable MCP is a Model Context Protocol (MCP) server that bridges the Scorable API with MCP client applications. It exposes Scorable evaluators as tools for AI assistants and agents, enabling automated evaluation of responses against various quality criteria.

How to use Scorable MCP?

Get an API key from Scorable, then run the server using Docker with SSE transport (docker run -e SCORABLE_API_KEY=<key> -p 9090:9090 ghcr.io/scorable/scorable-mcp:latest) or via stdio using uvx. Configure the server in your MCP client (e.g., Cursor) by pointing to the SSE endpoint or adding the stdio command with the API key.

Key features of Scorable MCP

  • Exposes Scorable evaluators as MCP tools
  • Supports SSE transport for network deployment
  • Compatible with MCP clients like Cursor
  • Tools for listing and running evaluations
  • Supports evaluation by name or ID
  • Includes a reference MCP client for Python

Use cases of Scorable MCP

  • Evaluate and improve AI agent explanations automatically.
  • Measure prompt templates for clarity and precision.
  • Run coding policy adherence evaluations using policy documents.
  • Use a combination of judges (collections of evaluators) for comprehensive assessment.

常见问题

1

How do I get an API key for Scorable MCP?

Sign up and create a key at scorable.ai/settings/api-keys, or generate a temporary key at scorable.ai/demo-user.

2

What transport methods does Scorable MCP support?

Scorable MCP supports SSE transport (via Docker, port 9090) and stdio transport (via `uvx`).

3

What are the main limitations of Scorable MCP?

The current implementation lacks exponential backoff, automatic retries, and request throttling. The bundled MCP client is for reference only and has no support guarantees.

4

Can I use Scorable MCP with Cursor?

Yes, the README provides example configurations for Cursor, using either SSE or stdio transport.

5

What kinds of evaluations can I run?

You can run standard evaluations by evaluator ID or name, coding policy adherence evaluations, and judges (collections of evaluators). Additional tools list all available evaluators and judges on your account.

评论

其他 分类下的更多 MCP 服务器

Codelf

unbug

A search tool helps dev to solve the naming things problem.

14.2K

YOUB

Connect your AI assistant to your own YOUB endurance training account. Read recorded activities with full analysis, planned sessions, race goals, wellness (HRV, sleep, resting HR) and your athletic profile. Create or mov

FastMCP v2 🚀

jlowin

🚀 The fast, Pythonic way to build MCP servers and clients.

26.0K

🚀 Model Context Protocol (MCP) Curriculum for Beginners

microsoft

This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable,

16.7K

Sequential Thinking

modelcontextprotocol

Model Context Protocol Servers

88.2K
广告合作