Claude Code · claude-haiku-4-5-20251001 · Playwright
anthropic
with my setupPlaywrightIts score and figures
Every figure the leaderboard's table prints for this setup.
| rank in group | 1–4 |
|---|---|
| Score | 79.3 pts78.5–79.8 pts |
| Pass rate | 100.0%≥ 92.6%100.0% · 48 of 50 graded |
| Efficiency | 17.013.8–19.1 |
| cost | 0.79× |
| tokens | 1.2× |
| time | 1.1× |
| Coverage | 1/6 |
| Runs | 50 |
75.0 + 1.4 + 0.2 + 2.6 ≈ 79.3 (outcome + cost + tokens + time)
- pass rate on each benchmark's own grader
- cost
- tokens
- time
- not measured
- First run
- 2026-09-28
- Last run
- 2026-09-28
- did not finish (scored as a fail)
- 0
- Tasks with no grade
- 2
On each benchmark
Each benchmark it ran: its status, pass rate, spend and spend per pass. The studies behind them are its evidence, below.
WindTunnel
79.3 pts
WindTunnel: 100.0% · 48 of 50 graded · scored
- cost
- 0.79× the typical spend per passing run10.4% of this setup's cost here went to runs that did not pass or were not graded; efficiency does not price it$0.08 per pass($0.05–$0.10)37% went to the costliest 10% of attempts (5 of 48)
- tokens
- 1.2× the typical spend per passing run10.5% of this setup's tokens here went to runs that did not pass or were not graded; efficiency does not price it470.8k per pass(331k–658.9k)39% went to the costliest 10% of attempts (5 of 48)of which 96% cache reads and 4% fresh input
- time
- 1.1× the typical spend per passing run8.3% of this setup's time here went to runs that did not pass or were not graded; efficiency does not price it1m 02s per pass(50.7s–1m 17s)28% went to the costliest 10% of attempts (5 of 48)
Efficiency and spend per pass can order setups differently: efficiency compares the typical (median) passing run, task by task, while spend per pass averages every attempt, so a few very expensive runs, passing or not, count in full; and spend per pass also counts the attempts that failed or did not finish, and divides by the pass rate. A setup is called the most frugal only where both put it first and both separate it from every other setup.
Evidence
Every published study its runs come from.