Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200μs of overhead at 5k RPS.
Popularity
Repository stars37,969Highest9,310
7-day net stars——
Fork3,188Highest1,515
30-day trendInsufficient historyInsufficient history
Browse by purposeAI & agents · Developer toolsCoding assistants
TypeAPIs & connectorsAPIs & connectors
SubcategoryModel APIsModel APIs
PlatformNot verifiedNot verified
Cost detailsCheck current official software, hosting, model and infrastructure pricing.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-032026-11-03
MetricRepository stars, not unique users or individual-skill installsRepository stars, not unique users or individual-skill installs
LanguageTypeScriptGo
About this projectOne local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control.Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200μs of overhead at 5k RPS.
Measured at2026-11-03 08:27 UTC2026-11-03 08:24 UTC
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.