All projects
Repositories in this selection 26 · UTC 2026-11-03
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Oollama / ollamaRun and manage language models locally.GoMIT · PermissiveInsufficient rank history185,69418,873——2026-11-02
2—Oopenai / whisperProvide speech-recognition models and audio-transcription code.PythonMIT · PermissiveInsufficient rank history111,78713,551——2026-08-31
3—QQwenLM / Qwen3Collect usage information and model entry points for the Qwen3 language-model family.PythonUnknown · Restricted / unknownInsufficient rank history27,7002,096——2026-01-09
4—Lliguodongiot / llm-actionThis project aims to share the technical principles and practical experience related to large models (large model engineering, large model application implementation)HTMLApache-2.0 · PermissiveInsufficient rank history25,2432,858——2026-10-14
5—Jjundot / omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu barPythonApache-2.0 · PermissiveInsufficient rank history23,3072,089——2026-11-03
6—NNVIDIA / TensorRT-LLMTensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.PythonNOASSERTION · Restricted / unknownInsufficient rank history14,9952,901——2026-11-03
7—Bbentoml / OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.PythonApache-2.0 · PermissiveInsufficient rank history12,581849——2026-11-02
8—Sskypilot-org / skypilotThe AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.PythonApache-2.0 · PermissiveInsufficient rank history10,7851,328——2026-11-03
9—Bbentoml / BentoMLThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!PythonApache-2.0 · PermissiveInsufficient rank history8,9331,055——2026-11-02
10—Fflyteorg / flyteType-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)GoApache-2.0 · PermissiveInsufficient rank history7,846918——2026-11-02
11—Vvllm-project / vllm-omniA framework for efficient model inference with omni-modality modelsPythonApache-2.0 · PermissiveInsufficient rank history7,5052,039——2026-11-03
12—Bbojieli / ai-infra-book"In-depth Understanding of AI Infra: Quantitative Analysis and System Design" (authored by Li Bojie) open source manuscript: Starting from hardware constraints and model architecture, quantitatively derive the design of LLM inference and training system. Includes the full text of the book, PDF, supporting calculation tools and experimentsPythonApache-2.0 · PermissiveInsufficient rank history7,263574——2026-10-01
13—Kkserve / kserveStandardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on KubernetesGoApache-2.0 · PermissiveInsufficient rank history6,1821,775——2026-11-02
14—MMichael-A-Kuykendall / shimmy⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.RustApache-2.0 · PermissiveInsufficient rank history6,008587——2026-11-01
15—Ggpustack / gpustackA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.PythonApache-2.0 · PermissiveInsufficient rank history5,956712——2026-11-03
16—Bbeclab / OlaresOpen-Source Personal Cloud OS for Always-On AgentsGoAGPL-3.0 · Share derivative sourceInsufficient rank history5,336332——2026-11-03
17—Ssuperduper-io / superduperSuperduper: End-to-end framework for building custom AI applications and agents.PythonApache-2.0 · PermissiveInsufficient rank history5,330546——2025-09-01
18—HHuaizhengZhang / AI-Infra-from-Zero-to-Hero🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.UnknownMIT · PermissiveInsufficient rank history4,459416——2025-07-25
19—Aahkarami / Deep-Learning-in-ProductionIn this repository, I will share some useful notes and references about deploying deep learning-based models in production.UnknownUnknown · Restricted / unknownInsufficient rank history4,378685——2024-11-09
20—MModelTC / LightLLMLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.PythonApache-2.0 · PermissiveInsufficient rank history4,351383——2026-11-03
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.