Anthropic
partialShows if the model has enough results for an index.Claude 3.7 Sonnet Thinking
Claude 3.7 Sonnet Thinking is a model from Anthropic. 6 benchmarks count toward its score, in 4 categories.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.55%
SpeedOutput tokens per second.—
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.N/A
EloLMArena rating and rank.N/A
The index is a score out of 100. The ± range shows how much it can change.
CapabilitiesScore per category, out of 100.
Out of 100Results
6 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| MGSM | Multilingual | 93.0% | — | — | 9 Jan 2026 | Vals AI |
| MATH 500 | Math | 91.6% | 44.2 | — | 9 Jan 2026 | Vals AI |
| MMLU Pro | Knowledge | 82.7% | 50.9 | — | 1 Sept 2026 | Vals AI |
| GPQA Diamond | Knowledge | 75.3% | 47.7 | — | 1 Sept 2026 | Vals AI |
| MMMU Pro | Multimodal | 75.1% | 49.6 | — | 1 Sept 2026 | Vals AI |
| LiveCodeBench | Coding | 60.4% | 39.3 | — | 1 Sept 2026 | Vals AI |
| AIME | Math | 44.6% | 34.5 | — | 16 Apr 2026 | Vals AI |
6 benchmarks count, from 6 of 7 results. A grey row does not count. Too few models took that benchmark.