Route
An alias picks the model: fallbacks when a provider fails, conditions on headers, formats and tokens, weighted splits.

Provider keys are encrypted with AES-256-GCM under a master key you hold. Apps get Kaeso keys instead, stored only as hashes.
Budgets and rate limits per project, member, service account and key. A hard budget refuses before any provider is called.
Every request lands in your own log with its key, member, model, tokens, time and its cost at the prices in force.
Organizations, projects, keys, limits, routes, request logs and a playground, in one console beside the gateway. This is the console itself, on sample data. Click through it.
Open the live demoOne Rust process between your apps and every provider. It checks the key and the limits, calls the provider with a key only it holds, and writes down what each request used and cost.
How a request travels| Time | Requests |
|---|---|
| Thu 17 Sep | 49,384 |
| Fri 18 Sep | 50,538 |
| Sat 19 Sep | 25,971 |
| Sun 20 Sep | 25,497 |
| Mon 21 Sep | 47,523 |
| Tue 22 Sep | 48,901 |
| Wed 23 Sep | 53,602 |
| Thu 24 Sep | 52,138 |
| Fri 25 Sep | 49,967 |
| Sat 26 Sep | 24,608 |
| Sun 27 Sep | 25,837 |
| Mon 28 Sep | 48,772 |
| Tue 29 Sep | 54,099 |
| Wed 30 Sep | 51,464 |
| Thu 1 Oct | 48,967 |
| Fri 2 Oct | 47,222 |
| Sat 3 Oct | 25,588 |
| Sun 4 Oct | 26,302 |
| Mon 5 Oct | 53,653 |
| Tue 6 Oct | 51,341 |
| Wed 7 Oct | 50,314 |
| Thu 8 Oct | 50,569 |
| Fri 9 Oct | 53,224 |
| Sat 10 Oct | 28,570 |
| Sun 11 Oct | 26,733 |
| Mon 12 Oct | 49,312 |
| Tue 13 Oct | 49,205 |
| Wed 14 Oct | 53,960 |
| Thu 15 Oct | 55,353 |
| Fri 16 Oct, partial | 49,097 |
Ada OkaforOwner
Noor HaddadAdmin
Lin ParkMember
Mateo SilvaMember
Priya RamanMember
Ada Okafor512 / 1882.3 s
Ada Okafor10 / 2728.4 s
Lin Park148 / 64920 ms$ curl -fsSL https://kaeso.app/install.sh | sh ==> Installing Kaeso in /home/ada/kaeso ==> Downloading Kaeso's images, about 2 GB; this takes a minute or two ==> Creating the master key ==> Starting Kaeso ==> Kaeso is running. Open this link to create the first user: https://localhost/setup#token=…
Apps keep their SDK and change two settings. From there, every call goes through the same eight checks, in the same order, before a provider ever sees it.
An alias picks the model: fallbacks when a provider fails, conditions on headers, formats and tokens, weighted splits.
Rates and budgets per project, member, service account and key. A hard budget refuses before the provider is called.
Every request lands in the log with its model, tokens, time and cost at the prices in force.
Ada Okafor· stored as a hashfrom openai import OpenAI client = OpenAI( base_url="https://kaeso.example.com/v1", api_key="sk-kso-…",) stream = client.chat.completions.create( model="fast-smart", messages=[{"role": "user", "content": [ {"type": "text", "text": "Is the parcel in this photo damaged?"}, {"type": "image_url", "image_url": {"url": photo}}, ]}], stream=True,)POST https://api.anthropic.com/v1/messagesanthropic-version: 2023-06-01content-type: application/json { "model": "claude-sonnet-5-5", "stream": true, "messages": [{ "role": "user", "content": [ { "type": "text", "text": "Is the parcel in this photo damaged?" }, { "type": "image", "source": { "type": "base64", … } } ] }]}HTTP/1.1 200 OKcontent-type: text/event-streamkaeso-request-id: req_01k8zq2nhf8cr4fdhmkpard1m2kaeso-provider: anthropickaeso-model: claude-sonnet-5-5kaeso-route: fast-smart;status=200server-timing: upload;dur=0.2, kaeso;dur=0.4, upstream;dur=702.0The key decides the project and who it acts for. Kaeso stores it only as a hash.
Ada Okafor· stored as a hashThe body is read in the app's own format. Anything Kaeso would never send on is refused here.
stream = client.chat.completions.create( model="fast-smart", messages=[{"role": "user", "content": [ {"type": "text", "text": "Is the parcel in this photo damaged?"}, {"type": "image_url", "image_url": {"url": photo}}, ]}], stream=True,)The name resolves in the project's catalogue. An alias's route picks the model and its fallbacks.
Every rate and budget of the key, the member and the project, checked at once.
The project's key for the provider, decrypted from AES-256-GCM under your master key.
The request is written in the provider's own format, and sent.
POST https://api.anthropic.com/v1/messagesanthropic-version: 2023-06-01content-type: application/json { "model": "claude-sonnet-5-5", "stream": true, "messages": [{ "role": "user", "content": [ { "type": "text", "text": "Is the parcel in this photo damaged?" }, { "type": "image", "source": { "type": "base64", … } } ] }]}Decoded, and encoded back into the app's format, event by event for a stream.
HTTP/1.1 200 OKcontent-type: text/event-streamkaeso-request-id: req_01k8zq2nhf8cr4fdhmkpard1m2kaeso-provider: anthropickaeso-model: claude-sonnet-5-5kaeso-route: fast-smart;status=200server-timing: upload;dur=0.2, kaeso;dur=0.4, upstream;dur=702.0Usage, the cost at the prices in force, and the request log, after the reply has gone out.
Ada Okafor· stored as a hashfrom openai import OpenAI client = OpenAI( base_url="https://kaeso.example.com/v1", api_key="sk-kso-…",) stream = client.chat.completions.create( model="fast-smart", messages=[{"role": "user", "content": [ {"type": "text", "text": "Is the parcel in this photo damaged?"}, {"type": "image_url", "image_url": {"url": photo}}, ]}], stream=True,)POST https://api.anthropic.com/v1/messagesanthropic-version: 2023-06-01content-type: application/json { "model": "claude-sonnet-5-5", "stream": true, "messages": [{ "role": "user", "content": [ { "type": "text", "text": "Is the parcel in this photo damaged?" }, { "type": "image", "source": { "type": "base64", … } } ] }]}HTTP/1.1 200 OKcontent-type: text/event-streamkaeso-request-id: req_01k8zq2nhf8cr4fdhmkpard1m2kaeso-provider: anthropickaeso-model: claude-sonnet-5-5kaeso-route: fast-smart;status=200server-timing: upload;dur=0.2, kaeso;dur=0.4, upstream;dur=702.0Per organization, through its own OpenID Connect provider, with two-factor and roles.
Encrypted under a master key you hold. Kaeso's own keys are stored only as hashes.
A hard budget refuses before the provider is called; a soft one sends an alert.
One portal per project. A tool whose definition changes waits for an admin.
Apps keep the OpenAI, Anthropic and Google SDKs and change two settings: the base URL and the key. Kaeso calls each of the 26 chat providers in its own format.
Every provider| Format | ||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Responses | ||||||||||||||||||||||||||
| Chat Completions | ||||||||||||||||||||||||||
| Messages | ||||||||||||||||||||||||||
| Gemini API |
OpenAI SDK, Chat Completions,Anthropictranslated through KPP into Messages
called in this formatreached through translation

$ curl -fsSL https://kaeso.app/install.sh | sh ==> Installing Kaeso in /home/ada/kaeso ==> Downloading Kaeso's images, about 2 GB; this takes a minute or two ==> Creating the master key ==> Starting Kaeso ==> Kaeso is running. Open this link to create the first user: https://localhost/setup#token=…
Caddy, the gateway, the console, PostgreSQL, ClickHouse and Valkey, with Docker Compose.
Or a template for Render, Railway, DigitalOcean, Fly.io, AWS, Azure, Google Cloud, Coolify, Dokploy and CapRover.
curl -fsSLhttps://kaeso.app/install.sh | shChecked on 6 November 2026 against each project's repository and documentation, where the others do more too.
See the sources in the README| Feature | Kaeso | LiteLLM | Bifrost | Portkey Gateway |
|---|---|---|---|---|
| Gateway written in | Rust | Python | Go | TypeScript |
| Licence | MIT | MIT, except enterprise/ | Apache 2.0 | MIT |
| Single sign-on when self-hosted for free | Yes, OpenID Connect | Up to 5 users | Enterprise | Enterprise |
| Budgets when self-hosted for free | Yes | Yes | Yes | Enterprise and some Pro plans |
| Web console when self-hosted | Yes | Yes | Yes | Request logs only |
| MCP portal for your own MCP servers | Yes, per project | Yes | Yes | Yes |


Free. All of it. Single sign-on, budgets and the console are in the MIT-licensed code. There is no enterprise edition.