EleutherAI / lm-evaluation-harness
Run language-model tasks and aggregate results through a shared evaluation framework.
Purpose and fit
Install the harness and desired model backend, then select tasks and run a configuration.
Use cases：For comparing language models with reusable task definitions. Selection note: Requires model access and compute; results depend on tasks, prompts and runtime configuration. Source ↗
Deployment：Install the harness and desired model backend, then select tasks and run a configuration.
- Browse by purpose
- Model and data evaluation
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck hosted-service, model and infrastructure costs for the option you choose.
Star trend (estimated)
Includes estimates from GitHub star history, excluded from net-growth rankings. Removed stars are absent and day boundaries are not guaranteed UTC; estimates are not historical end-of-day net totals.Repository info
Repository Stars, not unique users
- Subcategory
- Evaluation tools
- Platform
- Not verified
- First collected
- 2026-11-02
- Language
- Python
- License
- MIT · Permissive
- Repository created
- 2020-08-28
- Last push
- 2026-09-14
- Measured at
- 2026-11-02 18:45 UTC
- Pricing
- Pricing not verified
- Cost details
- Check hosted-service, model and infrastructure costs for the option you choose.
- Maintenance notes
- Unknown
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.
Tags
Historical observations
Raw observations below are not daily gains.
| Measured at | stars | Source |
|---|---|---|
| 2026-11-02 18:45:22 UTC | 14,375 | Source |
1 / 1