広告掲載
MCP.so
ログイン

Root Signals MCP Server

@root-signals

リポジトリホームページ

基本情報

カテゴリ

その他

トランスポート

stdio

作者

root-signals

Root Signals MCP Server について

MCP for Scorable Evaluation Platform

#evals#llm-as-a-judge

Root Signals MCP Server の設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "root-signals-mcp": {
      "command": "docker",
      "args": [
        "run",
        "-e",
        "SCORABLE_API_KEY=<your_key>",
        "-p",
        "0.0.0.0:9090:9090",
        "--name=rs-mcp",
        "-d",
        "ghcr.io/scorable/scorable-mcp:latest"
      ]
    }
  }
}

Root Signals MCP Server のツール

ツール一覧はまだありません

この掲載には表示できるツール一覧がまだありません。サーバーにツールがないという意味ではありません。対応機能はプロジェクトのドキュメントをご確認ください。

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is Scorable MCP?

Scorable MCP is a Model Context Protocol (MCP) server that bridges the Scorable API with MCP client applications. It exposes Scorable evaluators as tools for AI assistants and agents, enabling automated evaluation of responses against various quality criteria.

How to use Scorable MCP?

Get an API key from Scorable, then run the server using Docker with SSE transport (docker run -e SCORABLE_API_KEY=<key> -p 9090:9090 ghcr.io/scorable/scorable-mcp:latest) or via stdio using uvx. Configure the server in your MCP client (e.g., Cursor) by pointing to the SSE endpoint or adding the stdio command with the API key.

Key features of Scorable MCP

  • Exposes Scorable evaluators as MCP tools
  • Supports SSE transport for network deployment
  • Compatible with MCP clients like Cursor
  • Tools for listing and running evaluations
  • Supports evaluation by name or ID
  • Includes a reference MCP client for Python

Use cases of Scorable MCP

  • Evaluate and improve AI agent explanations automatically.
  • Measure prompt templates for clarity and precision.
  • Run coding policy adherence evaluations using policy documents.
  • Use a combination of judges (collections of evaluators) for comprehensive assessment.

よくある質問

1

How do I get an API key for Scorable MCP?

Sign up and create a key at scorable.ai/settings/api-keys, or generate a temporary key at scorable.ai/demo-user.

2

What transport methods does Scorable MCP support?

Scorable MCP supports SSE transport (via Docker, port 9090) and stdio transport (via `uvx`).

3

What are the main limitations of Scorable MCP?

The current implementation lacks exponential backoff, automatic retries, and request throttling. The bundled MCP client is for reference only and has no support guarantees.

4

Can I use Scorable MCP with Cursor?

Yes, the README provides example configurations for Cursor, using either SSE or stdio transport.

5

What kinds of evaluations can I run?

You can run standard evaluations by evaluator ID or name, coding policy adherence evaluations, and judges (collections of evaluators). Additional tools list all available evaluators and judges on your account.

コメント

「その他」の他のコンテンツ

Yuppsy

Yuppsy MCP: build and publish real estate websites from your AI assistant. Yuppsy lets your AI assistant create live websites for real estate agents and individual property listings. You don't need a designer or any code

Maestro

mobile-dev-inc

Painless E2E Automation for Mobile and Web

14.8K

Awesome Mlops

visenger

A curated list of references for MLOps

14.0K

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K
N

Next Generation Movers: free moving quotes (remote MCP)

Next Generation Movers

Free moving quotes for AI agents from Next Generation Movers, a licensed interstate mover (USDOT 3764697). US long-distance nationwide and local DC/MD/VA. Indicative ballpark price and booking options; optional $0.01 x40

広告掲載