Evaluation tools
Repositories in this selection 25 · UTC 2026-11-03
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Wwg / wrkModern HTTP benchmarking toolCNOASSERTION · Restricted / unknownInsufficient rank history40,4263,026——2023-12-30
2—Ssharkdp / hyperfineA command-line tool for benchmarking command execution.RustApache-2.0 · PermissiveInsufficient rank history29,199665——2026-11-01
3—Cconfident-ai / deepevalThe LLM Evaluation FrameworkPythonApache-2.0 · PermissiveInsufficient rank history19,2662,163——2026-11-02
4—Rraga-ai-hub / RagaAI-CatalystPython SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph viewPythonApache-2.0 · PermissiveInsufficient rank history16,1873,575——2026-02-11
5—EEleutherAI / lm-evaluation-harnessRun language-model tasks and aggregate results through a shared evaluation framework.PythonMIT · PermissiveInsufficient rank history14,3753,751——2026-09-14
6—Ddotnet / BenchmarkDotNetA library for benchmarking .NET code.C#MIT · PermissiveInsufficient rank history11,5261,081——2026-11-01
7—Ggoogle / benchmarkA library for writing and running microbenchmarks.C++Apache-2.0 · PermissiveInsufficient rank history10,4991,825——2026-11-02
8—Mmcollina / autocannonfast HTTP/1.1 benchmarking tool written in Node.jsJavaScriptMIT · PermissiveInsufficient rank history8,535345——2026-05-16
9—Oopen-compass / opencompassManage language-model evaluations, dataset configurations and result summaries.PythonApache-2.0 · PermissiveInsufficient rank history7,561899——2026-11-02
10—Ccodesenberg / bombardierFast cross-platform HTTP benchmarking tool written in GoGoMIT · PermissiveInsufficient rank history6,849332——2026-10-10
11—Eevcxr / evcxrInteractive Rust evaluation tools, including a Jupyter kernel, a Rust REPL and related shared libraries.RustNOASSERTION · Restricted / unknownInsufficient rank history6,513241——2026-10-27
12—Eerikbern / ann-benchmarksA Python benchmark project comparing approximate-nearest-neighbor libraries.PythonMIT · PermissiveInsufficient rank history5,747908——2026-07-10
13—Bbheisler / criterion.rsA Rust benchmarking library using statistical analysis.RustApache-2.0 · PermissiveInsufficient rank history5,546360——2026-04-23
14—Ssix-ddc / plowA high-performance HTTP benchmarking tool that includes a real-time web UI and terminal displayGoApache-2.0 · PermissiveInsufficient rank history4,515154——2026-10-17
15—EEvolvingLMMs-Lab / lmms-evalA multimodal evaluation toolkit covering text, image, video, and audio tasks.PythonNOASSERTION · Restricted / unknownInsufficient rank history4,479683——2026-11-02
16—Oopen-compass / VLMEvalKitOpen-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarksPythonApache-2.0 · PermissiveInsufficient rank history4,472788——2026-11-03
17—DdevMEremenko / XcodeBenchmarkA benchmark measuring large-project compilation times in Xcode on Mac hardware.PythonMIT · PermissiveInsufficient rank history3,688414——2026-10-16
18—OOpenDCAI / DataFlex[NeurIPS 2026] DataFlex: A Unified Benchmark and Evaluation Platform for Data-Centric Training of Large Language ModelsPythonApache-2.0 · PermissiveInsufficient rank history3,385512——2026-10-21
19—Iianarawjo / ChainForgeAn open-source visual programming environment for battle-testing prompts to LLMs.TypeScriptMIT · PermissiveInsufficient rank history3,040260——2026-10-29
20—Pprocessone / tsungTsung is a high-performance benchmark framework for various protocols including HTTP, XMPP, LDAP, etc.ErlangGPL-2.0 · Share derivative sourceInsufficient rank history2,630403——2026-03-02
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.