All projects
Repositories in this selection 4 · UTC 2026-11-05
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Ddeepspeedai / DeepSpeedDeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.PythonApache-2.0 · PermissiveInsufficient rank history43,2835,060——2026-11-02
2—FFareedKhan-dev / kimi-k3-in-cA 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.CApache-2.0 · PermissiveInsufficient rank history9,5551,541——2026-10-02
3—Bbojieli / ai-infra-book"In-depth Understanding of AI Infra: Quantitative Analysis and System Design" (authored by Li Bojie) open source manuscript: Starting from hardware constraints and model architecture, quantitatively derive the design of LLM inference and training system. Includes the full text of the book, PDF, supporting calculation tools and experimentsPythonApache-2.0 · PermissiveInsufficient rank history7,263574——2026-10-01
4—Aalgorithmicsuperintelligence / optillmOptimizing inference proxy for LLMsPythonApache-2.0 · PermissiveInsufficient rank history4,335398——2026-11-02
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.