LLM Gateway
The LLM Gateway is Routero AI’s unified proxy — an OpenAI-compatible interface in front of 100+ providers, with four composable governance primitives built in.
Pages in this section
- Models — add and manage the models your organisation can call
- API Keys — create and manage the virtual keys your applications call with
- Bring Your Own Key (BYOK) — use your own provider keys; you pay the provider directly, Routero charges markup only
- Auto Router — intent-based model selection by message content
- Routing & Load Balancing — strategies, model groups, and the Router
- Failover & Fallbacks — multi-provider failover chains
- Policies — bundle guardrails, prompts, memory, knowledge, web search, and token saving into a named policy
- MCP Gateway — register MCP tool servers once; agents, scripts, and standard MCP clients call them through Routero