Claude Code · claude-haiku-4-5-20251001 · WebMCP
anthropic
with my setupWebMCPIts score and figures
Every figure the leaderboard's table prints for this setup.
| rank in group | 1–4 |
|---|---|
| Score | 81.1 pts79.9–82.6 pts |
| Pass rate | 100.0%≥ 92.7%100.0% · 49 of 50 graded |
| Efficiency | 24.519.6–30.6 |
| cost | 0.44× |
| tokens | 0.93× |
| time | 0.90× |
| Coverage | 1/6 |
| Runs | 50 |
75.0 + 2.5 + 0.3 + 3.3 = 81.1 (outcome + cost + tokens + time)
- pass rate on each benchmark's own grader
- cost
- tokens
- time
- not measured
- First run
- 2026-09-28
- Last run
- 2026-09-28
- did not finish (scored as a fail)
- 0
- Tasks with no grade
- 1
On each benchmark
Each benchmark it ran: its status, pass rate, spend and spend per pass. The studies behind them are its evidence, below.
WindTunnel
81.1 pts
WindTunnel: 100.0% · 49 of 50 graded · scored
- cost
- 0.44× the typical spend per passing run2.0% of this setup's cost here went to runs that did not pass or were not graded; efficiency does not price it$0.03 per pass($0.03–$0.03)19% went to the costliest 10% of attempts (5 of 49)
- tokens
- 0.93× the typical spend per passing run2.0% of this setup's tokens here went to runs that did not pass or were not graded; efficiency does not price it182.5k per pass(164.6k–203.7k)19% went to the costliest 10% of attempts (5 of 49)of which 96% cache reads and 3% fresh input
- time
- 0.90× the typical spend per passing run1.9% of this setup's time here went to runs that did not pass or were not graded; efficiency does not price it37.6s per pass(33.9s–42.5s)20% went to the costliest 10% of attempts (5 of 49)
Efficiency and spend per pass can order setups differently: efficiency compares the typical (median) passing run, task by task, while spend per pass averages every attempt, so a few very expensive runs, passing or not, count in full; and spend per pass also counts the attempts that failed or did not finish, and divides by the pass rate. A setup is called the most frugal only where both put it first and both separate it from every other setup.
Evidence
Every published study its runs come from.