広告掲載
MCP.so
ログイン
I

Inferbench MCP Server

@JoniMartin27

リポジトリ

基本情報

カテゴリ

その他

トランスポート

stdio

作者

JoniMartin27

投稿者

Jonathan Martin Paez

Inferbench MCP Server について

InferBench's MCP server lets coding agents run, serve and benchmark local LLMs (text + image, llama.cpp + Stable Diffusion) on your own hardware on demand. Measures real tokens/sec, picks the optimal quant for your GPU, and exposes a 124-model catalog. Local-first, no cloud requi

#llm#local-llm#benchmark#llama-cpp#inference#image-generation

Inferbench MCP Server の設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "inferbench": {
      "command": "C:\\Users\\<user>\\AppData\\Local\\Programs\\InferBench\\resources\\sidecar\\inferbench-backend.exe",
      "args": [
        "--mcp"
      ]
    }
  }
}

Inferbench MCP Server のツール

ツール一覧はまだありません

この掲載には表示できるツール一覧がまだありません。サーバーにツールがないという意味ではありません。対応機能はプロジェクトのドキュメントをご確認ください。

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is Inferbench?

Inferbench is an MCP server that lets coding agents run, serve, and benchmark local LLMs (text + image, via llama.cpp and Stable Diffusion) on your own hardware. It measures real tokens/second, picks the optimal quantization for your GPU, and exposes a 124-model catalog.

How to use Inferbench?

—

Key features of Inferbench

  • Run, serve, and benchmark local LLMs on demand
  • Measures real tokens per second throughput
  • Selects optimal quantization for your GPU automatically
  • Supports text and image models (llama.cpp + Stable Diffusion)
  • Exposes a catalog of 124 models
  • Operates entirely local-first, no cloud required

Use cases of Inferbench

  • Benchmarking local LLM performance across different quantizations and hardware
  • Running coding agent tasks against locally served text and image models
  • Identifying the best-performing model quantization for a given GPU

よくある質問

1

What models does Inferbench support?

Inferbench supports text models via llama.cpp and image models via Stable Diffusion, with a catalog of 124 models.

2

Where does data stay and is the cloud required?

Inferbench is local-first and requires no cloud.

3

What performance metrics does Inferbench measure?

It measures real tokens per second throughput.

コメント

「その他」の他のコンテンツ

DeepMark

DeepMark helps teachers deliver rapid, consistent marking with meaningful feedback for every student — in a fraction of the time. What once took a week, now takes one free period.

EverArt

modelcontextprotocol

Model Context Protocol Servers

88.1K

ICSS

chokcoco

不止于 CSS

20.7K

Glasswarp

Glasswarp

See and control a real Windows PC you own — from any MCP client, locally or remotely. Observe (UIA + screenshots), click/type/drag/scroll, launch apps, owner Live View. BYOH: your machine, your key.

Soar Flight Booking MCP

Soar Flight Booking MCP is a remote MCP server available at https://mcp.soar.flights.

広告掲載