Skip to content

Every model.One gateway.Yours.

One API in frontof every providerrun by you27 providers
Self-hosted · one Rust process · no enterprise edition

Own your keys.Own your limits.Own the record.

Your keys never leave the gateway.

Provider keys are encrypted with AES-256-GCM under a master key you hold. Apps get Kaeso keys instead, stored only as hashes.

Spend stops where you say.

Budgets and rate limits per project, member, service account and key. A hard budget refuses before any provider is called.

Know who asked. Know what it cost.

Every request lands in your own log with its key, member, model, tokens, time and its cost at the prices in force.

Command every call.

Organizations, projects, keys, limits, routes, request logs and a playground, in one console beside the gateway. This is the console itself, on sample data. Click through it.

Open the live demo

No model call without a key, a limit and a log.

One Rust process between your apps and every provider. It checks the key and the limits, calls the provider with a key only it holds, and writes down what each request used and cost.

How a request travels
Request logsEvery call, its time and its price
  1. 200OKclaude-sonnet-5-52.3 s
  2. 200OKgpt-5.4-mini1.2 s
  3. 200OKgpt-image-28.4 s
  4. 200OKtts-1640 ms
  5. 200OKclaude-haiku-5-5920 ms
  6. 429Rate limitedgpt-6-sol—
  7. 200OKclaude-sonnet-5-53.4 s
  8. 200OKgpt-6-sol3 s
ModelsOne catalogue, with aliases and routes
  • Claude Haiku 5.5claude-haiku-5-5$0.10 / $0.50
  • Claude Sonnet 5.5claude-sonnet-5-5$2.00 / $10.00
  • GPT-5.4 minigpt-5.4-mini$0.75 / $4.50
  • GPT-6 Solgpt-6-sol$2.00 / $10.00
  • gpt-image-2gpt-image-2$5.00 / $30.00
  • TTS-1tts-1$15.00
BudgetsA hard one refuses before you pay
  • ProjectHard limit
    46 of 600 · Per minute
  • Key checkout-webHard limit
    152,300 of 400,000 · Per minute
  • Member Lin ParkHard limit
    $21.60 of $25.00 · Per day
  • Service account checkout-workerSoft limit
    6.41M of 20M · Per day
  • Key ci-smoke-testsHard limit
    $3.18 of $10.00 · Per day
27 providersBuilt in, each called in its own format
  • OpenAI
  • Anthropic
  • Baseten
  • Cerebras
  • Cohere
  • DeepSeek
  • ElevenLabs
  • Fireworks AI
  • Gemini Enterprise Agent Platform
  • Google AI Studio
  • Groq
  • Hugging Face
  • MiniMax
  • Mistral
  • Moonshot
  • Nebius Token Factory
  • NVIDIA
  • Ollama Cloud
  • OpenRouter
  • QwenCloud
  • SambaNova
  • Scaleway
  • SiliconFlow
  • SpaceX
  • Together AI
  • Vercel
  • Z.ai
UsageThirty days of the sample organization
Requests
1,327,711
Tokens
2.81B
Cost
$8,056.77
RequestsTokensCost
Requests per day, last 30 days, sample data
TimeRequests
Thu 17 Sep49,384
Fri 18 Sep50,538
Sat 19 Sep25,971
Sun 20 Sep25,497
Mon 21 Sep47,523
Tue 22 Sep48,901
Wed 23 Sep53,602
Thu 24 Sep52,138
Fri 25 Sep49,967
Sat 26 Sep24,608
Sun 27 Sep25,837
Mon 28 Sep48,772
Tue 29 Sep54,099
Wed 30 Sep51,464
Thu 1 Oct48,967
Fri 2 Oct47,222
Sat 3 Oct25,588
Sun 4 Oct26,302
Mon 5 Oct53,653
Tue 6 Oct51,341
Wed 7 Oct50,314
Thu 8 Oct50,569
Fri 9 Oct53,224
Sat 10 Oct28,570
Sun 11 Oct26,733
Mon 12 Oct49,312
Tue 13 Oct49,205
Wed 14 Oct53,960
Thu 15 Oct55,353
Fri 16 Oct, partial49,097
Single sign-onYour OpenID Connect provider, roles, two-factor
Northwind Labs · MembersSingle sign-on required
  • Ada OkaforOwner
  • Noor HaddadAdmin
  • Lin ParkMember
  • Mateo SilvaMember
  • Priya RamanMember
MCP portalA changed tool waits for review
Checkout assistant · Toolshttps://kaeso.example.com/mcp/proj_…
  • orders__get_orderOn
  • orders__list_ordersOn
  • orders__track_shipmentOn
  • orders__update_addressOn
  • orders__refund_orderDestructive
  • orders__cancel_orderHeld for review
GatewayOne Rust process in front of every provider
ConsoleKeys, limits, routes and logs, live on sample data
  1. 200OKclaude-sonnet-5-52.3 s
  2. 200OKgpt-5.4-mini1.2 s
  3. 200OKgpt-image-28.4 s
  4. 200OKtts-1640 ms
  5. 200OKclaude-haiku-5-5920 ms
  1. 14:02:16200OKclaude-sonnet-5-5Ada Okafor512 / 1882.3 s
  2. 14:02:07200OKgpt-5.4-minicheckout-worker212 / 961.2 s
  3. 14:02:01200OKgpt-image-2Ada Okafor10 / 2728.4 s
  4. 14:01:57200OKtts-1checkout-worker—640 ms
  5. 14:01:52200OKclaude-haiku-5-5Lin Park148 / 64920 ms
InstallOne command on any Linux server
$ curl -fsSL https://kaeso.app/install.sh | sh
==> Installing Kaeso in /home/ada/kaeso
==> Downloading Kaeso's images, about 2 GB; this takes a minute or two
==> Creating the master key
==> Starting Kaeso
==> Kaeso is running. Open this link to create the first user:
https://localhost/setup#token=…

Every request answers to you.

Apps keep their SDK and change two settings. From there, every call goes through the same eight checks, in the same order, before a provider ever sees it.

model: "fast-smart"Claude Sonnet 5.5claude-sonnet-5-5Fallback: GPT-6 Sol

Route

An alias picks the model: fallbacks when a provider fails, conditions on headers, formats and tokens, weighted splits.

ProjectHard limit
46 of 600 · Per minute
Key checkout-webHard limit
152,300 of 400,000 · Per minute

Limit

Rates and budgets per project, member, service account and key. A hard budget refuses before the provider is called.

200OKOKreq_01k8zq2nhf8cr4fdhmkpard1m2
Claude Sonnet 5.5claude-sonnet-5-5
Asked for
fast-smart
Tokens in / out
1,840 / 412
Cost
$0.00780
Key
checkout-web

Record

Every request lands in the log with its model, tokens, time and cost at the prices in force.

Nothing reachesa providerunchecked.

Eight steps, in order

The request path

Key01

The key decides the project and who it acts for. Kaeso stores it only as a hash.

Northwind Labs / Checkout assistantsk-kso-Q2xA…a91fInferencecheckout-web ·Ada Okafor· stored as a hash
can refuse: 401, 403

Decode02

The body is read in the app's own format. Anything Kaeso would never send on is refused here.

checkout.py
stream = client.chat.completions.create(    model="fast-smart",    messages=[{"role": "user", "content": [        {"type": "text", "text": "Is the parcel in this photo damaged?"},        {"type": "image_url", "image_url": {"url": photo}},    ]}],    stream=True,)
can refuse: 400, 413, 503

Model03

The name resolves in the project's catalogue. An alias's route picks the model and its fallbacks.

model: "fast-smart"Claude Sonnet 5.5claude-sonnet-5-5Fallback: GPT-6 Sol
can refuse: 400, 404

Limits04

Every rate and budget of the key, the member and the project, checked at once.

ProjectHard limit
46 of 600 · Per minute
Key checkout-webHard limit
152,300 of 400,000 · Per minute
can refuse: 403, 429, 503

Provider key05

The project's key for the provider, decrypted from AES-256-GCM under your master key.

Anthropicsk-ant-…3f2a · AES‑256‑GCM
can refuse: 400

Encode and send06

The request is written in the provider's own format, and sent.

api.anthropic.com
POST https://api.anthropic.com/v1/messagesanthropic-version: 2023-06-01content-type: application/json {  "model": "claude-sonnet-5-5",  "stream": true,  "messages": [{ "role": "user", "content": [    { "type": "text", "text": "Is the parcel in this photo damaged?" },    { "type": "image", "source": { "type": "base64", … } }  ] }]}
can refuse: 502, 504

Reply07

Decoded, and encoded back into the app's format, event by event for a stream.

checkout.py
HTTP/1.1 200 OKcontent-type: text/event-streamkaeso-request-id: req_01k8zq2nhf8cr4fdhmkpard1m2kaeso-provider: anthropickaeso-model: claude-sonnet-5-5kaeso-route: fast-smart;status=200server-timing: upload;dur=0.2, kaeso;dur=0.4, upstream;dur=702.0
can refuse: 529

Log08

Usage, the cost at the prices in force, and the request log, after the reply has gone out.

200OKOKreq_01k8zq2nhf8cr4fdhmkpard1m2
Claude Sonnet 5.5claude-sonnet-5-5
Asked for
fast-smart
Tokens in / out
1,840 / 412
Cost
$0.00780
Key
checkout-web
never holds the reply
  1. 01KeyThe key decides the project and who it acts for. Kaeso stores it only as a hash.
    Northwind Labs / Checkout assistantsk-kso-Q2xA…a91fInferencecheckout-web ·Ada Okafor· stored as a hash
  2. 02DecodeThe body is read in the app's own format. Anything Kaeso would never send on is refused here.
    checkout.py
    from openai import OpenAI client = OpenAI(    base_url="https://kaeso.example.com/v1",    api_key="sk-kso-…",) stream = client.chat.completions.create(    model="fast-smart",    messages=[{"role": "user", "content": [        {"type": "text", "text": "Is the parcel in this photo damaged?"},        {"type": "image_url", "image_url": {"url": photo}},    ]}],    stream=True,)
  3. 03ModelThe name resolves in the project's catalogue. An alias's route picks the model and its fallbacks.
    model: "fast-smart"Claude Sonnet 5.5claude-sonnet-5-5Fallback: GPT-6 Sol
  4. 04LimitsEvery rate and budget of the key, the member and the project, checked at once.
    ProjectHard limit
    46 of 600 · Per minute
    Key checkout-webHard limit
    152,300 of 400,000 · Per minute
  5. 05Provider keyThe project's key for the provider, decrypted from AES-256-GCM under your master key.
    Anthropicsk-ant-…3f2a · AES‑256‑GCM
  6. 06Encode and sendThe request is written in the provider's own format, and sent.
    api.anthropic.com
    POST https://api.anthropic.com/v1/messagesanthropic-version: 2023-06-01content-type: application/json {  "model": "claude-sonnet-5-5",  "stream": true,  "messages": [{ "role": "user", "content": [    { "type": "text", "text": "Is the parcel in this photo damaged?" },    { "type": "image", "source": { "type": "base64", … } }  ] }]}
  7. 07ReplyDecoded, and encoded back into the app's format, event by event for a stream.
    checkout.py
    HTTP/1.1 200 OKcontent-type: text/event-streamkaeso-request-id: req_01k8zq2nhf8cr4fdhmkpard1m2kaeso-provider: anthropickaeso-model: claude-sonnet-5-5kaeso-route: fast-smart;status=200server-timing: upload;dur=0.2, kaeso;dur=0.4, upstream;dur=702.0
  8. 08LogUsage, the cost at the prices in force, and the request log, after the reply has gone out.
    200OKOKreq_01k8zq2nhf8cr4fdhmkpard1m2
    Claude Sonnet 5.5claude-sonnet-5-5
    Asked for
    fast-smart
    Tokens in / out
    1,840 / 412
    Cost
    $0.00780
    Key
    checkout-web

Built to run yourself

Single sign-on

Per organization, through its own OpenID Connect provider, with two-factor and roles.

OIDC

Provider keys

Encrypted under a master key you hold. Kaeso's own keys are stored only as hashes.

AES-256-GCM

Budgets

A hard budget refuses before the provider is called; a soft one sends an alert.

Hard, soft

MCP portal

One portal per project. A tool whose definition changes waits for an admin.

Held for review

One door. Every model.

Apps keep the OpenAI, Anthropic and Google SDKs and change two settings: the base URL and the key. Kaeso calls each of the 26 chat providers in its own format.

Every provider
27
Providers built in
4
Formats apps speak
8
Checks per request
1
Rust process
Anthropic2 of 26

OpenAI SDK, Chat Completions,Anthropictranslated through KPP into Messages

called in this formatreached through translation

Not a service.Software you run.

install.sh, on a fresh server
$ curl -fsSL https://kaeso.app/install.sh | sh

==> Installing Kaeso in /home/ada/kaeso

==> Downloading Kaeso's images, about 2 GB; this takes a minute or two

==> Creating the master key

==> Starting Kaeso

==> Kaeso is running. Open this link to create the first user:

https://localhost/setup#token=…

Caddy, the gateway, the console, PostgreSQL, ClickHouse and Valkey, with Docker Compose.

Or a template for Render, Railway, DigitalOcean, Fly.io, AWS, Azure, Google Cloud, Coolify, Dokploy and CapRover.

curl -fsSLhttps://kaeso.app/install.sh | sh

How it compares.

Checked on 6 November 2026 against each project's repository and documentation, where the others do more too.

See the sources in the README
FeatureKaesoLiteLLMBifrostPortkey Gateway
Gateway written inRustPythonGoTypeScript
LicenceMITMIT, except enterprise/Apache 2.0MIT
Single sign-on when self-hosted for freeYes, OpenID ConnectUp to 5 usersEnterpriseEnterprise
Budgets when self-hosted for freeYesYesYesEnterprise and some Pro plans
Web console when self-hostedYesYesYesRequest logs only
MCP portal for your own MCP serversYes, per projectYesYesYes
  • Gateway written in
    Kaeso
    Rust
    LiteLLM
    Python
    Bifrost
    Go
    Portkey Gateway
    TypeScript
  • Licence
    Kaeso
    MIT
    LiteLLM
    MIT, except enterprise/
    Bifrost
    Apache 2.0
    Portkey Gateway
    MIT
  • Single sign-on when self-hosted for free
    Kaeso
    Yes, OpenID Connect
    LiteLLM
    Up to 5 users
    Bifrost
    Enterprise
    Portkey Gateway
    Enterprise
  • Budgets when self-hosted for free
    Kaeso
    Yes
    LiteLLM
    Yes
    Bifrost
    Yes
    Portkey Gateway
    Enterprise and some Pro plans
  • Web console when self-hosted
    Kaeso
    Yes
    LiteLLM
    Yes
    Bifrost
    Yes
    Portkey Gateway
    Request logs only
  • MCP portal for your own MCP servers
    Kaeso
    Yes, per project
    LiteLLM
    Yes
    Bifrost
    Yes
    Portkey Gateway
    Yes

Own the record.

Free. All of it. Single sign-on, budgets and the console are in the MIT-licensed code. There is no enterprise edition.