Anthropic
availableShows if the model has enough results for an index.Claude 3 Haiku
Claude 3 Haiku is a non-reasoning model from Anthropic. 13 benchmarks count toward its score, in 7 categories.
IndexOverall score out of 100.21.1 ±5.0
CoverageShare of the index weight with results.95%
SpeedOutput tokens per second.73/s
Input / 1MUS dollars per 1M input tokens.$0.25
Output / 1MUS dollars per 1M output tokens.$1.25
ContextMaximum tokens in one request.200K
EloLMArena rating and rank.1195 (#307)
The index is a score out of 100. The ± range shows how much it can change.
117,701 votes. Elo shows what people prefer. It does not change the score.
CapabilitiesScore per category, out of 100.
Out of 100Results
13 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| SWE-bench Verified | Coding | 40.6% | 30.1 | Tools | 1 Sept 2026 | SWE-bench team |
| Artificial Analysis GPQA Diamond | Knowledge | 37.4% | 6.9 | — | — | Artificial Analysis |
| GPQA diamond | Knowledge | 36.3% | 11.8 | — | — | Epoch AI |
| Artificial Analysis IFBench | Instruction | 36.1% | 25.8 | — | — | Artificial Analysis |
| Artificial Analysis MMMU-Pro | Multimodal | 30.8% | 5.0 | — | — | Artificial Analysis |
| Artificial Analysis Long Context Reasoning | Reasoning | 27.7% | 27.4 | — | — | Artificial Analysis |
| τ²-Bench Tool-Agent-User Evaluation | Agentic | 21.1% | 14.0 | — | — | Victor Barres et al. |
| Artificial Analysis Omniscience Accuracy | Knowledge | 17.6% | 35.6 | — | — | Artificial Analysis |
| MATH level 5 | Math | 14.9% | 5.9 | — | — | Epoch AI |
| Artificial Analysis Intelligence Index | Knowledge | 5.6% | 29.4 | — | — | Artificial Analysis |
| Artificial Analysis Humanity's Last Exam | Knowledge | 4.1% | 29.0 | — | — | Artificial Analysis |
| OTIS Mock AIME 2024-2025 | Math | 1.8% | 12.7 | — | — | Epoch AI |
| Critical Physics Tasks | Reasoning | 0.0% | 38.4 | — | — | Artificial Analysis |
13 benchmarks count, from 13 of 13 results. A grey row does not count. Too few models took that benchmark.