Skip to main content
Uno LLM Gateway is a high-performance, open-source gateway written in Golang. It is designed to provide a unified interface to interact with large language models from various providers like OpenAI, Anthropic, and Gemini. It sits between your application and the LLM providers and provides access control via virtual keys, and observability through OTEL traces.

​
Key Features

  • Unified API: Interact with different LLM providers using a single, consistent request/response format.
  • Virtual Keys: Protect your provider API keys by using Uno-generated virtual keys in your client applications.
  • Centralized Configuration: Manage provider settings through a user-friendly UI without changing code.
  • Deep Observability: Automatically capture traces, token usage, and latency metrics for every request using ClickHouse and OpenTelemetry.

​
Supported Models

The gateway currently has support for the OpenAI, Gemini and Anthropic. Support for more provider are in the roadmap.
ProvidersTextImageTool callsReasoning
OpenAI
✅
✅
✅
✅
Anthropic
✅
❌
✅
✅
Gemini
✅
✅
✅
✅

​
Next Steps

Quickstart

Get Uno running locally in less than 5 minutes.

SDK Modes

Understand the difference between Gateway and Direct modes.