All projects
Repositories in this selection 23 · UTC 2026-11-04
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Mmodelscope / FunASROpen-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.PythonMIT · PermissiveInsufficient rank history20,9132,102——2026-11-02
2—Mmeta-llama / llama-cookbookWelcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider servicesJupyter NotebookMIT · PermissiveInsufficient rank history18,5782,753——2026-05-19
3—Bbudtmo / docker-androidAndroid in docker solution with noVNC supported, video recording, mcp server and AI-agentPythonNOASSERTION · Restricted / unknownInsufficient rank history16,0811,783——2026-11-02
4—OOrchestra-Research / AI-Research-SKILLsComprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.TeXMIT · PermissiveInsufficient rank history14,223992——2026-10-11
5—Hhalfrost / Halfrost-Field✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field Frost Land: Source code analysis, system design and engineering practice notesGoCC-BY-SA-4.0 · Share derivative sourceInsufficient rank history13,2551,876——2026-09-30
6—LLMCache / LMCacheAuthor description: LMCache: Supercharge Your LLM with the Fastest KV Cache LayerPythonApache-2.0 · PermissiveInsufficient rank history12,2662,118——2026-11-03
7—OOpenRLHF / OpenRLHFAn Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)PythonApache-2.0 · PermissiveInsufficient rank history10,1361,055——2026-11-03
8—Xxorbitsai / inferenceAuthor description: Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.PythonApache-2.0 · PermissiveInsufficient rank history9,639892——2026-11-03
9—Aai-dynamo / dynamoA Datacenter Scale Distributed Inference Serving FrameworkRustNOASSERTION · Restricted / unknownInsufficient rank history8,4301,809——2026-11-03
10—Kkvcache-ai / MooncakeMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.C++Apache-2.0 · PermissiveInsufficient rank history6,9611,428——2026-11-03
11—Vvllm-project / semantic-routerAn open, programmable decision layer for models and compute.GoApache-2.0 · PermissiveInsufficient rank history6,3871,102——2026-11-03
12—Kkserve / kserveStandardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on KubernetesGoApache-2.0 · PermissiveInsufficient rank history6,1821,775——2026-11-02
13—Mmostlygeek / llama-swapReliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.GoMIT · PermissiveInsufficient rank history6,166536——2026-11-03
14—Ggpustack / gpustackA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.PythonApache-2.0 · PermissiveInsufficient rank history5,956712——2026-11-03
15—OOpenBMB / UltraRAGA Low-Code MCP Framework for Building Complex and Innovative RAG PipelinesPythonApache-2.0 · PermissiveInsufficient rank history5,738458——2026-11-02
16—Xxlite-dev / Awesome-LLM-Inference📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉PythonGPL-3.0 · Share derivative sourceInsufficient rank history5,542443——2026-10-20
17—Sskyzh / tiny-llmlearn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + QwenPythonApache-2.0 · PermissiveInsufficient rank history5,529505——2026-10-31
18—Kkatanaml / sparrowStructured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLMPythonGPL-3.0 · Share derivative sourceInsufficient rank history5,232518——2026-10-29
19—Llemony-ai / cascadeflowCascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.PythonMIT · PermissiveInsufficient rank history3,930880——2026-09-25
20—PPaddlePaddle / FastDeployHigh-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddlePythonApache-2.0 · PermissiveInsufficient rank history3,724758——2026-09-24
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.