OpenAI
partialShows if the model has enough results for an index.o1-preview
o1-preview is a reasoning model from OpenAI in the o1 family. 7 benchmarks count toward its score, in 3 categories.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.45%
SpeedOutput tokens per second.—
Input / 1MUS dollars per 1M input tokens.$15
Output / 1MUS dollars per 1M output tokens.$60
ContextMaximum tokens in one request.200K
EloLMArena rating and rank.1353 (#191)
The index is a score out of 100. The ± range shows how much it can change.
31,122 votes. Elo shows what people prefer. It does not change the score.
CapabilitiesScore per category, out of 100.
Out of 100Results
7 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| MATH level 5 | Math | 81.6% | 38.8 | — | — | Epoch AI |
| Artificial Analysis GPQA Diamond | Knowledge | 76.5% | 47.0 | — | — | Artificial Analysis |
| SWE-bench Verified | Coding | 64.6% | 49.3 | W&B Programmer O1 crosscheck5 | 1 Sept 2026 | SWE-bench team |
| GPQA diamond | Knowledge | 50.3% | 24.7 | — | — | Epoch AI |
| Artificial Analysis Coding Index | Coding | 34.0% | 43.0 | — | — | Artificial Analysis |
| OTIS Mock AIME 2024-2025 | Math | 31.1% | 29.0 | — | — | Epoch AI |
| Artificial Analysis Intelligence Index | Knowledge | 11.4% | 36.6 | — | — | Artificial Analysis |
7 benchmarks count, from 7 of 7 results. A grey row does not count. Too few models took that benchmark.