Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Author description: Rainbond is an open-source container platform that requires no Kubernetes expertise. Its core capabilities are 100% open source. It abstracts away infrastructure complexity and provides a unified way to deploy and manage business applications, AI-generated projects, open-source AI software, and large language model services. AI helps teams deploy
Popularity
Repository stars2526,292Highest
7-day net stars——
Fork43882Highest
30-day trendInsufficient historyInsufficient history
Maintenance
Last push2026-11-032026-11-02
Maintenance notesNot verifiedNot verified
Repository created2025-11-122017-11-05
License & use
LicenseApache-2.0 · PermissiveLicense not declared
Cost detailsCheck current official software, hosting, model and infrastructure pricing.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-032026-11-03
MetricRepository stars, not unique users or individual-skill installsRepository stars, not unique users or individual-skill installs
LanguageGoGo
About this projectKubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.Author description: Rainbond is an open-source container platform that requires no Kubernetes expertise. Its core capabilities are 100% open source. It abstracts away infrastructure complexity and provides a unified way to deploy and manage business applications, AI-generated projects, open-source AI software, and large language model services. AI helps teams deploy
Measured at2026-11-03 08:28 UTC2026-11-02 18:59 UTC
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.