广告合作
MCP.so
登录
I

Inferbench MCP Server

@JoniMartin27

代码仓库

基本信息

分类

其他

传输方式

stdio

作者

JoniMartin27

提交者

Jonathan Martin Paez

关于 Inferbench MCP Server

InferBench's MCP server lets coding agents run, serve and benchmark local LLMs (text + image, llama.cpp + Stable Diffusion) on your own hardware on demand. Measures real tokens/sec, picks the optimal quant for your GPU, and exposes a 124-model catalog. Local-first, no cloud requi

#llm#local-llm#benchmark#llama-cpp#inference#image-generation

Inferbench MCP Server 配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "inferbench": {
      "command": "C:\\Users\\<user>\\AppData\\Local\\Programs\\InferBench\\resources\\sidecar\\inferbench-backend.exe",
      "args": [
        "--mcp"
      ]
    }
  }
}

Inferbench MCP Server 工具

工具列表暂未提供

当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is Inferbench?

Inferbench is an MCP server that lets coding agents run, serve, and benchmark local LLMs (text + image, via llama.cpp and Stable Diffusion) on your own hardware. It measures real tokens/second, picks the optimal quantization for your GPU, and exposes a 124-model catalog.

How to use Inferbench?

—

Key features of Inferbench

  • Run, serve, and benchmark local LLMs on demand
  • Measures real tokens per second throughput
  • Selects optimal quantization for your GPU automatically
  • Supports text and image models (llama.cpp + Stable Diffusion)
  • Exposes a catalog of 124 models
  • Operates entirely local-first, no cloud required

Use cases of Inferbench

  • Benchmarking local LLM performance across different quantizations and hardware
  • Running coding agent tasks against locally served text and image models
  • Identifying the best-performing model quantization for a given GPU

常见问题

1

What models does Inferbench support?

Inferbench supports text models via llama.cpp and image models via Stable Diffusion, with a catalog of 124 models.

2

Where does data stay and is the cloud required?

Inferbench is local-first and requires no cloud.

3

What performance metrics does Inferbench measure?

It measures real tokens per second throughput.

评论

其他 分类下的更多 MCP 服务器

🚀 Model Context Protocol (MCP) Curriculum for Beginners

microsoft

This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable,

16.7K

Sequential Thinking

modelcontextprotocol

Model Context Protocol Servers

88.2K

Glasswarp

Glasswarp

See and control a real Windows PC you own — from any MCP client, locally or remotely. Observe (UIA + screenshots), click/type/drag/scroll, launch apps, owner Live View. BYOH: your machine, your key.

Yuppsy

Yuppsy MCP: build and publish real estate websites from your AI assistant. Yuppsy lets your AI assistant create live websites for real estate agents and individual property listings. You don't need a designer or any code

MaxKB

1Panel-dev

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

22.0K
广告合作