Compare projects
Select 2–4 projects to compare on the same basis.
Only identical known values are hidden. Unknown information remains visible.
NTensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Popularity
Repository stars27,700Highest14,995
7-day net stars——
Fork2,0962,901Highest
30-day trendInsufficient historyInsufficient history
Maintenance
Last push2026-01-092026-11-03
Maintenance notesUnknownNot verified
Repository created2024-02-052023-08-16
License & use
LicenseLicense not declaredLicense not declared
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeModel servingModel serving
TypeModels & adaptersModels & adapters
SubcategoryLanguage modelsLanguage models
PlatformNot verifiedNot verified
Cost detailsCheck hosted-service, model and infrastructure costs for the option you choose.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-022026-11-03
MetricRepository Stars, not unique usersRepository stars, not unique users or individual-skill installs
LanguagePythonPython
About this projectCollect usage information and model entry points for the Qwen3 language-model family.TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Measured at2026-11-02 18:45 UTC2026-11-03 08:24 UTC
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.