OpenAI
partialShows if the model has enough results for an index.GPT-4
GPT-4 is a model from OpenAI. 1 benchmark counts toward its score, in 1 category.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.20%
SpeedOutput tokens per second.44/s
Input / 1MUS dollars per 1M input tokens.$30
Output / 1MUS dollars per 1M output tokens.$60
ContextMaximum tokens in one request.8K
EloLMArena rating and rank.1186 (#314)
The index is a score out of 100. The ± range shows how much it can change.
88,723 votes. Elo shows what people prefer. It does not change the score.
CapabilitiesScore per category, out of 100.
Out of 100Results
1 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| SWE-bench Lite | Coding | 23.7% | 23.4 | OpenCSG StarShip CodeGenAgent | 11 Sept 2025 | SWE-bench team |
| SWE-bench Lite | Coding | 19.0% | 19.4 | AutoCodeRover | 11 Sept 2025 | SWE-bench team |
1 benchmarks count, from 2 of 2 results. A grey row does not count. Too few models took that benchmark.