MCP.so
ログイン
I

Inferbench

@JoniMartin27

リポジトリ

Inferbench について

InferBench's MCP server lets coding agents run, serve and benchmark local LLMs (text + image, llama.cpp + Stable Diffusion) on your own hardware on demand. Measures real tokens/sec, picks the optimal quant for your GPU, and exposes a 124-model catalog. Local-first, no cloud requi

#llm#local-llm#benchmark#llama-cpp#inference#image-generation

基本情報

カテゴリ

その他

トランスポート

stdio

公開者

JoniMartin27

投稿者

Jonathan Martin Paez

設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "inferbench": {
      "command": "C:\\Users\\<user>\\AppData\\Local\\Programs\\InferBench\\resources\\sidecar\\inferbench-backend.exe",
      "args": [
        "--mcp"
      ]
    }
  }
}

ツール

ツールは検出されませんでした

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is Inferbench?

Inferbench is an MCP server that lets coding agents run, serve, and benchmark local LLMs (text + image, via llama.cpp and Stable Diffusion) on your own hardware. It measures real tokens/second, picks the optimal quantization for your GPU, and exposes a 124-model catalog.

How to use Inferbench?

—

Key features of Inferbench

  • Run, serve, and benchmark local LLMs on demand
  • Measures real tokens per second throughput
  • Selects optimal quantization for your GPU automatically
  • Supports text and image models (llama.cpp + Stable Diffusion)
  • Exposes a catalog of 124 models
  • Operates entirely local-first, no cloud required

Use cases of Inferbench

  • Benchmarking local LLM performance across different quantizations and hardware
  • Running coding agent tasks against locally served text and image models
  • Identifying the best-performing model quantization for a given GPU

FAQ from Inferbench

What models does Inferbench support?

Inferbench supports text models via llama.cpp and image models via Stable Diffusion, with a catalog of 124 models.

Where does data stay and is the cloud required?

Inferbench is local-first and requires no cloud.

What performance metrics does Inferbench measure?

It measures real tokens per second throughput.

コメント

「その他」の他のコンテンツ

🪟 Windows-MCP

CursorTouch

MCP Server for Computer Use in Windows

6.3K

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K

Core Philosophy: Connect, Unify, Respond

mindsdb

Delegate anything. It comes back done.

39.4K

🚀 Model Context Protocol (MCP) Curriculum for Beginners

microsoft

This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable,

16.7K

Awesome-MCP-ZH

yzfly

MCP 资源精选， MCP指南，Claude MCP，MCP Servers, MCP Clients

7.4K