llmbridge
A C++ OpenAI-compatible LLM gateway designed for microsecond-level conversion
SITE CAPTUREBased on information published on the service's website. Selection and review policy
WHAT IT DOES
What does it do?
llmbridge is a C++ gateway between applications and model providers that converts OpenAI-format requests into each provider’s format and converts responses back. It can run as a standalone binary, or its conversion calls can be embedded directly in a C++ application. The public repository is an open-core offering for a single upstream; multi-provider routing and observability are provided in a commercial tier.
KEY FEATURES
Key features
- Convert OpenAI API requests into formats used by multiple model providers
- Convert provider responses back into an OpenAI-compatible format
- Provide a standalone gateway binary
- Embed the conversion library in C++ applications
- Scale across CPU cores with multiple workers
- Relay large numbers of concurrent token streams