开源序

Compare projects

Select 2–4 projects to compare on the same basis.

Only identical known values are hidden. Unknown information remains visible.

LiteRT-LM

Author description: LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Popularity
Repository stars6,805Highest6,008
7-day net stars——
Fork780Highest587
30-day trendInsufficient historyInsufficient history
Maintenance
Last push2026-11-032026-11-01
Maintenance notesNot verifiedNot verified
Repository created2025-04-142025-08-28
License & use
LicenseApache-2.0 · PermissiveApache-2.0 · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeData analysisCommand-line tools · Data analysis · Model serving
TypeFrameworks & SDKsFrameworks & SDKs
SubcategoryData science & machine learningData science & machine learning
PlatformNot verifiedNot verified
Cost detailsCheck current official software, hosting, model and infrastructure pricing.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-032026-11-03
MetricRepository stars, not unique users or individual-skill installsRepository stars, not unique users or individual-skill installs
LanguageC++Rust
About this projectAuthor description: LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Measured at2026-11-03 08:25 UTC2026-11-03 08:24 UTC

License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.