Anthropic
partialShows if the model has enough results for an index.Claude 3.5 Sonnet (October 2024)
Claude 3.5 Sonnet (October 2024) is a model from Anthropic. 5 benchmarks count toward its score, in 2 categories.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.25%
SpeedOutput tokens per second.—
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.N/A
EloLMArena rating and rank.N/A
The index is a score out of 100. The ± range shows how much it can change.
CapabilitiesScore per category, out of 100.
Out of 100Results
5 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| MATH level 5 | Math | 56.9% | 26.6 | — | — | Epoch AI |
| GPQA diamond | Knowledge | 55.3% | 29.3 | — | — | Epoch AI |
| OTIS Mock AIME 2024-2025 | Math | 8.5% | 16.4 | — | — | Epoch AI |
| FrontierMath-2025-02-28-Private | Math | 2.1% | 32.6 | — | — | Epoch AI |
| FrontierMath-Tier-4-2025-07-01-Private | Math | 0.0% | 43.4 | — | — | Epoch AI |
5 benchmarks count, from 5 of 5 results. A grey row does not count. Too few models took that benchmark.