All projects
Repositories in this selection 6 · UTC 2026-11-04
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Xxorbitsai / inferenceAuthor description: Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.PythonApache-2.0 · PermissiveInsufficient rank history9,639892——2026-11-03
2—Aai-dynamo / dynamoA Datacenter Scale Distributed Inference Serving FrameworkRustNOASSERTION · Restricted / unknownInsufficient rank history8,4301,809——2026-11-03
3—Kkvcache-ai / MooncakeMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.C++Apache-2.0 · PermissiveInsufficient rank history6,9611,428——2026-11-03
4—Ggpustack / gpustackA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.PythonApache-2.0 · PermissiveInsufficient rank history5,956712——2026-11-03
5—GGen-Verse / OpenClaw-RLOpenClaw-RL: Train any agent simply by talkingPythonApache-2.0 · PermissiveInsufficient rank history5,745614——2026-05-23
6—Ppatchy631 / time-to-first-tokenA 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.HTMLApache-2.0 · PermissiveInsufficient rank history1,012115——2026-08-14
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.