Code
LiveCodeBench-style
610 tasks, v1, graded by the benchmark's own execution tests.
task text withheld
In the leaderboard
no run admitted to the leaderboard yet
This benchmark's own board: newest eligible study per setup.
live
No rows on this board yet.
A row appears here the moment a study of this benchmark is published.
The card
Declared data only — nothing here is inferred or scored.
Identity
- Category
- Code
- Corpus
- 610 tasks · v1
- Lenses
- execution
- Graded by
- the benchmark's own execution tests
- Headline
- Pass rate
Protocol
- Repeats
- 1 recommended
- Sample floor
- 50 tasks
- Chance anchor
- Derived from the pinned corpus's answer formats.
Access and licence
- Dataset
- open
- Task text
- withheld — board figures publish, task text does not
- Licence
- CC-BY-4.0
- Catalog
- featured
Disclosures
- Contamination
- No contamination data declared.
- Conflict of interest
- None declared.
Evidence
The published studies of this benchmark: every run, trajectory and grade, on the studies site.
Published studies of LiveCodeBench
0
None published yet.