SWE-bench / SWE-bench
Organize software-engineering agent evaluation around real repository issues.
Purpose and fit
Prepare task data and predictions and run the documented Docker evaluation flow.
Use cases：For evaluating coding agents on real repository issues. Selection note: Scores from different subsets and evaluation conditions are not directly interchangeable. Source ↗
Deployment：Prepare task data and predictions and run the documented Docker evaluation flow.
- Browse by purpose
- Model and data evaluation · Software testing
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck hosted-service, model and infrastructure costs for the option you choose.
Star trend (estimated)
Includes estimates from GitHub star history, excluded from net-growth rankings. Removed stars are absent and day boundaries are not guaranteed UTC; estimates are not historical end-of-day net totals.Repository info
Repository Stars, not unique users
- Subcategory
- Benchmarks
- Platform
- Not verified
- First collected
- 2026-11-02
- Language
- Python
- License
- MIT · Permissive
- Repository created
- 2023-10-04
- Last push
- 2026-09-18
- Measured at
- 2026-11-02 18:45 UTC
- Pricing
- Pricing not verified
- Cost details
- Check hosted-service, model and infrastructure costs for the option you choose.
- Maintenance notes
- Unknown
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.
Tags
Historical observations
Raw observations below are not daily gains.
| Measured at | stars | Source |
|---|---|---|
| 2026-11-02 18:45:22 UTC | 6,133 | Source |
1 / 1