Inferbench MCP Server

@JoniMartin27

代码仓库

基本信息

分类

其他

传输方式

stdio

作者

JoniMartin27

提交者

Jonathan Martin Paez

关于 Inferbench MCP Server

InferBench's MCP server lets coding agents run, serve and benchmark local LLMs (text + image, llama.cpp + Stable Diffusion) on your own hardware on demand. Measures real tokens/sec, picks the optimal quant for your GPU, and exposes a 124-model catalog. Local-first, no cloud requi

#llm #local-llm #benchmark#llama-cpp#inference #image-generation

Inferbench MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "inferbench": {
      "command": "C:\\Users\\<user>\\AppData\\Local\\Programs\\InferBench\\resources\\sidecar\\inferbench-backend.exe",
      "args": [
        "--mcp"
      ]
    }
  }
}

Inferbench MCP Server 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is Inferbench?

Inferbench is an MCP server that lets coding agents run, serve, and benchmark local LLMs (text + image, via llama.cpp and Stable Diffusion) on your own hardware. It measures real tokens/second, picks the optimal quantization for your GPU, and exposes a 124-model catalog.

How to use Inferbench?

—

Key features of Inferbench

Run, serve, and benchmark local LLMs on demand
Measures real tokens per second throughput
Selects optimal quantization for your GPU automatically
Supports text and image models (llama.cpp + Stable Diffusion)
Exposes a catalog of 124 models
Operates entirely local-first, no cloud required

Use cases of Inferbench

Benchmarking local LLM performance across different quantizations and hardware
Running coding agent tasks against locally served text and image models
Identifying the best-performing model quantization for a given GPU

常见问题

What models does Inferbench support?

Inferbench supports text models via llama.cpp and image models via Stable Diffusion, with a catalog of 124 models.

Where does data stay and is the cloud required?

Inferbench is local-first and requires no cloud.

What performance metrics does Inferbench measure?

It measures real tokens per second throughput.

其他分类下的更多 MCP 服务器

Handl

Handl speaks the Model Context Protocol. Your whole billing operation — projects, invoices, clients, reports, approvals — as tools any AI assistant can call, inside your autonomy rules.

Activepieces

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

23.2K

Health by Dr Brad

Dr Brad Stanfield

Health by Dr Brad works out a health plan from your own results: which screening is due at your age, and evidence-based suggestions, each with the reason and the published guideline or study behind it. Your record is one

Maestro

mobile-dev-inc

Painless E2E Automation for Mobile and Web

14.8K

The Living Bread

A free remote MCP server for The Living Bread. Bible passages read word for word from a stored public domain text with an evidence label, keyword search and cross references, real churches, gatherings and prayer groups w