Anthropic
availableShows if the model has enough results for an index.Claude 3.7 Sonnet
Claude 3.7 Sonnet is a model from Anthropic. 12 benchmarks count toward its score, in 5 categories.
IndexOverall score out of 100.40.3 ±7.2
CoverageShare of the index weight with results.75%
SpeedOutput tokens per second.—
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.N/A
EloLMArena rating and rank.1299 (#235)
The index is a score out of 100. The ± range shows how much it can change.
42,448 votes. Elo shows what people prefer. It does not change the score.
CapabilitiesScore per category, out of 100.
Out of 100Results
12 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| MGSM | Multilingual | 92.4% | — | — | 9 Jan 2026 | Vals AI |
| MATH level 5 | Math | 88.1% | 42.0 | — | — | Epoch AI |
| MMLU Pro | Knowledge | 80.7% | 47.6 | — | 1 Sept 2026 | Vals AI |
| MATH 500 | Math | 76.8% | 27.6 | — | 9 Jan 2026 | Vals AI |
| GPQA diamond | Knowledge | 76.8% | 49.1 | — | — | Epoch AI |
| τ²-bench Retail | Agentic | 72.1% | 50.6 | Sierra | 30 Apr 2026 | Sierra Research |
| MMMU Pro | Multimodal | 71.5% | 43.7 | — | 1 Sept 2026 | Vals AI |
| GPQA Diamond | Knowledge | 67.4% | 40.5 | — | 1 Sept 2026 | Vals AI |
| τ²-bench Airline | Agentic | 64.2% | 44.9 | Sierra | 2 Mar 2026 | Sierra Research |
| SWE-bench Verified | Coding | 62.4% | 47.6 | SWE-agent | 1 Sept 2026 | SWE-bench team |
| SWE-Bench verified | Coding | 61.0% | 46.4 | — | — | Epoch AI |
| LiveCodeBench | Coding | 56.7% | 35.9 | — | 1 Sept 2026 | Vals AI |
| SWE-bench Verified | Coding | 52.8% | 39.9 | mini-SWE-agent | 26 Feb 2026 | SWE-bench team |
| OTIS Mock AIME 2024-2025 | Math | 50.0% | 39.5 | — | — | Epoch AI |
| τ²-bench Telecom | Agentic | 49.0% | 34.0 | Sierra | 2 Mar 2026 | Sierra Research |
| SWE-bench Lite | Coding | 48.0% | 44.2 | SWE-agent | 11 Sept 2025 | SWE-bench team |
| SWE-bench Lite | Coding | 48.0% | 44.2 | SWE-agent | 11 Sept 2025 | SWE-bench team |
| SWE-bench (full test split) | Coding | 33.8% | — | SWE-agent 1.0 | 19 Dec 2025 | SWE-bench team |
| SWE-bench Multimodal | Multimodal | 30.9% | — | OpenHands-Versa | 17 Nov 2025 | SWE-bench team |
| SWE-bench Multimodal | Multimodal | 30.9% | — | OpenHands-Versa | 17 Nov 2025 | SWE-bench team |
| AIME | Math | 22.3% | 24.1 | — | 16 Apr 2026 | Vals AI |
| FrontierMath-2025-02-28-Private | Math | 3.3% | 33.7 | — | — | Epoch AI |
12 benchmarks count, from 18 of 22 results. A grey row does not count. Too few models took that benchmark.