GPT-5.1 Thinking

GPT-5.1 Thinking is a model from OpenAI. It has 2 scored results in 1 category. It has no index.

  • Input: text
partialShows if the model has enough results for an index.
IndexOverall score out of 100.UnrankedMedian 50.7
CoverageShare of the index weight with results.15%
SpeedOutput tokens per second.—Median 62/s
First tokenSeconds to the first output token.N/AMedian 1.6 s
Input / 1MUS dollars per 1M input tokens.N/AMedian $0.6
Output / 1MUS dollars per 1M output tokens.N/AMedian $2.5
ContextMaximum tokens in one request.N/AMedian 262K
EloLMArena rating and rank.N/AMedian 1427

Capabilities

Score per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None countedN/A—
CodingCode writing and repair.None countedN/A—
ReasoningLogic problems and puzzles.2 counted32.8—
MultimodalTasks with images and text.None countedN/A—
KnowledgeFacts and expert knowledge.None countedN/A—
MultilingualTasks in many languages.None countedN/A—
InstructionTasks with strict rules in the prompt.None countedN/A—
MathMath problems.None countedN/A—

Results

2 counted
BenchmarkThe test name.ResultThe score from the source.PlacePlace among results on this benchmark.
ARC-AGI-2 (semi-private)Reasoning0.4%108 / 122
ARC-AGI-1 (semi-private)Reasoning5.8%109 / 117
ARC-AGI-2 (public eval)Reasoning0.0%93 / 113
ARC-AGI-1 (public eval)Reasoning12.4%98 / 107

Sources

BenchLM benchmark aggregationCC BY-NC 4.0 · Data from BenchLM.aiARC Prize Foundation, collected directlyNo licence stated. Their terms ask for written permission before commercial use

More from OpenAI

All models
GPT-6 Astra82.1GPT-6.1 Sol79.9GPT-5.5 Pro77.3GPT-6 Sol76.3GPT-5.4 Pro75.8