Agentic
SWE-bench Verified-style
500 tasks, v1, graded by the benchmark's own verifier.
task text withheldlicence unverified
In the leaderboard
no run admitted to the leaderboard yet
This benchmark's own board: newest eligible study per setup.
live
No rows on this board yet.
A row appears here the moment a study of this benchmark is published.
The card
Declared data only — nothing here is inferred or scored.
Identity
- Category
- Agentic
- Corpus
- 500 tasks · v1
- Lenses
- verifier
- Graded by
- the benchmark's own verifier
- Headline
- Pass rate
Protocol
- Repeats
- 1 recommended
- Sample floor
- 25 tasks
- Chance anchor
- Derived from the pinned corpus's answer formats.
Access and licence
- Dataset
- open
- Task text
- withheld — board figures publish, task text does not
- Licence
- dataset card (unverified)
- Catalog
- featured
Disclosures
- Contamination
- No contamination data declared.
- Conflict of interest
- None declared.
Evidence
The published studies of this benchmark: every run, trajectory and grade, on the studies site.
Published studies of SWE-bench Verified
0
None published yet.