开源序

Compare projects

Select 2–4 projects to compare on the same basis.

Only identical known values are hidden. Unknown information remains visible.

lmms-eval

A multimodal evaluation toolkit covering text, image, video, and audio tasks.

RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Popularity
Repository stars4,47916,187Highest
7-day net stars——
Fork6833,575Highest
30-day trendInsufficient historyInsufficient history
Maintenance
Last push2026-11-022026-02-11
Maintenance notesUnknownNot verified
Repository created2024-03-072024-08-26
License & use
LicenseLicense not declaredApache-2.0 · Permissive
License source—License source
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeModel and data evaluationModel and data evaluation
TypeDatasets & evaluationsDatasets & evaluations
SubcategoryEvaluation toolsEvaluation tools
PlatformNot verifiedNot verified
Cost detailsVerify software, hosting, model and infrastructure costs against the current official documentation.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-022026-11-03
MetricRepository Stars, not unique usersRepository stars, not unique users or individual-skill installs
LanguagePythonPython
About this projectA multimodal evaluation toolkit covering text, image, video, and audio tasks.Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
Measured at2026-11-02 19:28 UTC2026-11-03 08:27 UTC

License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.