All projects
Repositories in this selection 8 · UTC 2026-11-03
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Ttensorflow / servingA flexible, high-performance serving system for machine learning modelsC++Apache-2.0 · PermissiveInsufficient rank history6,3652,203——2026-10-21
2—Vvolcano-sh / volcanoA Cloud Native Batch System (Project under CNCF)GoApache-2.0 · PermissiveInsufficient rank history6,0581,605——2026-11-03
3—Sskyzh / tiny-llmlearn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + QwenPythonApache-2.0 · PermissiveInsufficient rank history5,529505——2026-10-31
4—SSeldonIO / seldon-coreAn MLOps framework to package, deploy, monitor and manage thousands of production machine learning modelsGoNOASSERTION · Restricted / unknownInsufficient rank history4,784861——2026-03-23
5—Aahkarami / Deep-Learning-in-ProductionIn this repository, I will share some useful notes and references about deploying deep learning-based models in production.UnknownUnknown · Restricted / unknownInsufficient rank history4,378685——2024-11-09
6—LLightning-AI / LitServeA minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.PythonApache-2.0 · PermissiveInsufficient rank history3,980322——2026-11-01
7—PPaddlePaddle / FastDeployHigh-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddlePythonApache-2.0 · PermissiveInsufficient rank history3,724758——2026-09-24
8—Ddingodb / dingoA multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.JavaApache-2.0 · PermissiveInsufficient rank history1,705263——2026-10-30
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.