GPT-5.1 vs Step 3.7 Flash

Change models
GPT-5.1OpenAI
IndexAll categories, out of 100.
55.3 ±3.7
55.3 ±5.0
GapIndex points below the top.
Top
Top
CoverageIndex weight that has results.
95% best
85%
SpeedOutput tokens per second.
50/s
112/s best
EloLMArena rating and rank.
1422
—
ReleasedMonth of release.
2025-11
2026-05
Input / 1MUS dollars per 1M input tokens.
$1.25
$0.20 best
Output / 1MUS dollars per 1M output tokens.
$10.00
$1.15 best
Batch output / 1MBatch price per 1M output tokens.
$5.00
—
1K chats2K tokens in, 500 out, each.
$7.50
$0.975 best
1K documents20K tokens in, 1K out, each.
$35.00
$5.15 best
1K agent tasks200K tokens in, 20K out, each.
$450.00
$63.00 best
ContextMaximum tokens in one request.
400K best
262K
AgenticMulti-step tasks with tools.
52.4
59.6 best
CodingCode writing and repair.
53.5
54.9 best
ReasoningLogic problems and puzzles.
56.4 best
49.6
MultimodalTasks with images and text.
58.4
59.3 best
KnowledgeFacts and expert knowledge.
57.2 best
46.8
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
57.1 best
51.9
MathMath problems.
57.5
—

Benchmarks

10 shared
Only GPT-5.1: 34Only Step 3.7 Flash: 11
GPT-5.1
Step 3.7 Flash
28.5% best87 / 222
21.4%110 / 222
80.0% best43 / 217
73.7%100 / 217
4.9% best84 / 214
2.3%104 / 214
87.3% best58 / 199
80.9%97 / 199
37.7% best62 / 164
25.8%101 / 164
81.9%66 / 149
98.5% best3 / 149
72.9% best33 / 146
67.3%54 / 146
16.3%85 / 133
25.8% best69 / 133
75.5% best48 / 113
75.3%52 / 113
41.2%35 / 52
51.6% best19 / 52