defilantech / LLMKube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Purpose and fit
Author description: Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Basic listing based on official public information; functionality has not been independently evaluated.
Sources: official source 1 · official source 2. Based on public basic information; not an in-depth evaluation.
- Browse by purpose
- Kubernetes operations · Self-hosted services
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
Cumulative
Observed Star trendRepository info
Repository stars, not unique users or individual-skill installs
- Type
- Apps & systems
- Subcategory
- Operations
- Platform
- Not verified
- First collected
- 2026-11-03
- Language
- Go
- License
- Apache-2.0 · Permissive
- Repository created
- 2025-11-12
- Last push
- 2026-11-03
- Measured at
- 2026-11-03 08:28 UTC
- Pricing
- Pricing not verified
- Cost details
- Check current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.
Tags
Historical observations
Raw observations below are not daily gains.
| Measured at | stars | Source |
|---|---|---|
| 2026-11-03 08:28:05 UTC | 252 | Source |