MCP.so
Sign In

OpenZiti / LLM-Gateway MCP ServerVerifiedFeatured

@openziti

Basic information

Category

AI & Agents

License

Apache-2.0

Author

openziti

Submitted by

Stephen Mackey

About OpenZiti / LLM-Gateway MCP Server

NetFoundry LLM Gateway is an OpenAI-compatible API proxy that routes requests across multiple LLM providers using zero-trust networking. Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load bala

OpenZiti / LLM-Gateway MCP Server config

No standard config provided

This server doesn't expose a parseable MCP config block in its README. See the repository for install instructions.

Repository

OpenZiti / LLM-Gateway MCP Server tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Llm Gateway?

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

How to use Llm Gateway?

The README includes setup instructions such as ### Using with Python OpenAI Client.

Key features of Llm Gateway

  • Single binary, zero infrastructure — one Go binary, one YAML file. No database, no message queue, no sidecar
  • OpenAI-compatible API: Drop-in replacement for OpenAI client libraries
  • Multi-provider routing: Automatically routes requests based on model name
  • Anthropic translation: Transparently converts OpenAI format to/from Anthropic's Messages API
  • Streaming support: Server-Sent Events (SSE) streaming for all providers

Use cases of Llm Gateway

  • Connect an MCP-compatible client to this repository's service.
  • Review the README-backed setup before enabling it in production.

Frequently asked questions

1

Where is the source code for Llm Gateway?

The source code is linked from the repository URL on this page.

2

Does Llm Gateway include a standard MCP config?

If the README contains a parseable MCP configuration block, it is shown in the Config tab.

Comments

More AI & Agents MCP servers