MCP.so
ログイン
I

Iris

@iris-eval

リポジトリ

Iris について

The first MCP-native eval and observability tool for AI agents. Any MCP-compatible agent discovers and uses Iris automatically — no SDK, no code changes. Log traces with hierarchical span trees, evaluate output quality with 12 built-in rules (PII detection, prompt injection, cost

#observability#evaluation#tracing#mcp#ai-agent#cost-tracking#pii-detection#monitoring#llm#claude

基本情報

カテゴリ

開発者ツール

トランスポート

stdio

公開者

iris-eval

投稿者

Ian Parent

設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "iris": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ]
    }
  }
}

ツール

ツールは検出されませんでした

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is Iris?

Iris is an open-source MCP server that logs every trace, evaluates output quality, and tracks costs across all your agents. Any MCP-compatible agent discovers and uses it automatically — no SDK or code changes required.

How to use Iris?

Add Iris to your MCP config (e.g., Claude Desktop) with "command": "npx", "args": ["@iris-eval/mcp-server"]. To enable the web dashboard, run npx @iris-eval/mcp-server --dashboard and open http://localhost:6920. Iris also supports global npm install, Docker, and HTTP transport with optional API key authentication.

Key features of Iris

  • Hierarchical trace logging with per-tool costs in USD
  • 12 built-in output evaluation rules (completeness, relevance, safety, cost)
  • Real-time web dashboard with dark-mode UI
  • Cost visibility with aggregate reports and budget thresholds
  • Custom eval rules using Zod schemas
  • SQLite storage, queryable instantly

Use cases of Iris

  • Detect PII leakage or hallucinated answers in agent responses
  • Monitor and control per-query costs across multiple agents
  • Evaluate agent output quality against custom rules
  • Debug inefficient tool-calling patterns in production agents

FAQ from Iris

What runtimes or dependencies does Iris require?

Iris requires Node.js (to run via npx or npm). It also supports Docker deployment.

Where does Iris store its data?

Iris stores logs and evaluations in a local SQLite database, defaulting to ~/.iris/iris.db.

What transport modes does Iris support?

Iris supports both stdio (default) and http transport. The HTTP mode can be secured with an API key, CORS restrictions, and rate limiting.

Is there a cloud version of Iris?

A cloud tier with PostgreSQL, team dashboards, and alerting is coming soon. Self-hosted Iris runs entirely on your machine.

How does Iris handle authentication and security?

When using HTTP transport, Iris supports API key authentication (timing-safe comparison), CORS restricted to localhost by default, rate limiting, Helmet security headers, and Zod input validation.

コメント

「開発者ツール」の他のコンテンツ

FastAPI-MCP

tadata-org

Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!

11.9K

MCP Unity Editor (Game Engine)

CoderGamester

Model Context Protocol (MCP) plugin to connect with Unity Editor — designed for Cursor, Claude Code, Codex, Windsurf and other IDEs

1.8K

Unity MCP (Server + Plugin)

IvanMurzak

AI Skills, MCP Tools, and CLI for Unity Engine. Full AI develop and test loop. Use cli for quick setup. Efficient token usage, advanced tools. Any C# method may be turned into a tool by a single line. Works with Claude Code, Gemini, Copilot, Cursor and any other absolutely for fr

3.5K

Huoshan Test

volcengine

2.4K

TalkToFigma

sonnylazuardi

TalkToFigma: MCP integration between AI Agent (Cursor, Claude Code, Codex) and Figma, allowing Agentic AI to communicate with Figma for reading designs and modifying them programmatically.

6.9K