Compare projects
Select 2–4 projects to compare on the same basis.
Only identical known values are hidden. Unknown information remains visible.
HAI-Infra-from-Zero-to-Hero
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
Jomlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Popularity
Repository stars4,45923,307Highest
7-day net stars——
Fork4162,089Highest
30-day trendInsufficient historyInsufficient history
Maintenance
Last push2025-07-252026-11-03
Maintenance notesNot verifiedNot verified
Repository created2019-01-072026-02-13
License & use
LicenseMIT · PermissiveApache-2.0 · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeModel servingModel serving
TypeGuides & collectionsApps & systems
SubcategoryGetting startedAI apps
PlatformNot verifiedNot verified
Cost detailsCheck current official software, hosting, model and infrastructure pricing.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-032026-11-03
MetricRepository stars, not unique users or individual-skill installsRepository stars, not unique users or individual-skill installs
Language—Python
About this project🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Measured at2026-11-03 09:36 UTC2026-11-03 08:27 UTC
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.