OpenZiti / LLM-Gateway MCP Server已验证已精选

What is Llm Gateway?

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

How to use Llm Gateway?

The README includes setup instructions such as ### Using with Python OpenAI Client.

Key features of Llm Gateway

• Single binary, zero infrastructure — one Go binary, one YAML file. No database, no message queue, no sidecar
• OpenAI-compatible API: Drop-in replacement for OpenAI client libraries
• Multi-provider routing: Automatically routes requests based on model name
• Anthropic translation: Transparently converts OpenAI format to/from Anthropic's Messages API
• Streaming support: Server-Sent Events (SSE) streaming for all providers

Use cases of Llm Gateway

• Connect an MCP-compatible client to this repository's service.
• Review the README-backed setup before enabling it in production.