All projects
Repositories in this selection 33 · UTC 2026-11-04
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Nnomic-ai / gpt4allGPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.C++MIT · PermissiveInsufficient rank history77,3468,262——2025-05-27
2—Ggitleaks / gitleaksFind secrets with Gitleaks 🔑GoMIT · PermissiveInsufficient rank history30,6032,330——2026-10-28
3—Lliguodongiot / llm-actionThis project aims to share the technical principles and practical experience related to large models (large model engineering, large model application implementation)HTMLApache-2.0 · PermissiveInsufficient rank history25,2432,858——2026-10-14
4—LLightning-AI / litgpt20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.PythonApache-2.0 · PermissiveInsufficient rank history13,7431,542——2026-11-01
5—Bbentoml / OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.PythonApache-2.0 · PermissiveInsufficient rank history12,581849——2026-11-02
6—Oopenvinotoolkit / openvinoOpenVINOTM is an open source toolkit for optimizing and deploying AI inferenceC++Apache-2.0 · PermissiveInsufficient rank history11,1033,520——2026-11-03
7—TTiiny-AI / PowerInferHigh-speed Large Language Model Serving for Local DeploymentC++MIT · PermissiveInsufficient rank history9,862613——2026-05-11
8—FFareedKhan-dev / kimi-k3-in-cA 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.CApache-2.0 · PermissiveInsufficient rank history9,5551,541——2026-10-02
9—Bbentoml / BentoMLThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!PythonApache-2.0 · PermissiveInsufficient rank history8,9331,055——2026-11-02
10—Aai-dynamo / dynamoA Datacenter Scale Distributed Inference Serving FrameworkRustNOASSERTION · Restricted / unknownInsufficient rank history8,4301,809——2026-11-03
11—IInternLM / lmdeployLMDeploy is a toolkit for compressing, deploying, and serving LLMs.PythonApache-2.0 · PermissiveInsufficient rank history8,129773——2026-11-03
12—Aalgorithmicsuperintelligence / openevolveOpen-source implementation of AlphaEvolvePythonApache-2.0 · PermissiveInsufficient rank history7,6961,206——2026-11-02
13—Bbojieli / ai-infra-book"In-depth Understanding of AI Infra: Quantitative Analysis and System Design" (authored by Li Bojie) open source manuscript: Starting from hardware constraints and model architecture, quantitatively derive the design of LLM inference and training system. Includes the full text of the book, PDF, supporting calculation tools and experimentsPythonApache-2.0 · PermissiveInsufficient rank history7,263574——2026-10-01
14—Ddrumih / turbo-fieldfareGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBookSwiftApache-2.0 · PermissiveInsufficient rank history7,113463——2026-10-26
15—Kkatanemo / planoPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.RustApache-2.0 · PermissiveInsufficient rank history7,106494——2026-10-24
16—Fflashinfer-ai / flashinferFlashInfer: Kernel Library for LLM ServingCudaApache-2.0 · PermissiveInsufficient rank history6,8421,688——2026-11-03
17—Kkserve / kserveStandardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on KubernetesGoApache-2.0 · PermissiveInsufficient rank history6,1821,775——2026-11-02
18—Ccactus-compute / cactusQuantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.C++NOASSERTION · Restricted / unknownInsufficient rank history6,174516——2026-09-26
19—Llemonade-sdk / lemonadeLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8ZkC++Apache-2.0 · PermissiveInsufficient rank history6,085551——2026-11-03
20—MMichael-A-Kuykendall / shimmy⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.RustApache-2.0 · PermissiveInsufficient rank history6,008587——2026-11-01
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.