o1 vs o4-mini

Change models
o1OpenAI
o4-miniOpenAI
IndexAll categories, out of 100.
44.5 ±4.1
44.7 ±3.0 best
GapIndex points below the top.
−0.2 · no clear gap
Top
CoverageIndex weight that has results.
95%
100% best
SpeedOutput tokens per second.
97/s
122/s best
EloLMArena rating and rank.
1366 best
1353
ReleasedMonth of release.
2024-12
2025-04
Input / 1MUS dollars per 1M input tokens.
$15.00
$1.10 best
Output / 1MUS dollars per 1M output tokens.
$60.00
$4.40 best
1K chats2K tokens in, 500 out, each.
$60.00
$4.40 best
1K documents20K tokens in, 1K out, each.
$360.00
$26.40 best
1K agent tasks200K tokens in, 20K out, each.
$4,200.00
$308.00 best
ContextMaximum tokens in one request.
200K
200K
AgenticMulti-step tasks with tools.
44.3 best
38.5
CodingCode writing and repair.
31.0
45.2 best
ReasoningLogic problems and puzzles.
43.6
44.9 best
MultimodalTasks with images and text.
55.9 best
52.0
KnowledgeFacts and expert knowledge.
46.8 best
40.8
MultilingualTasks in many languages.
—
35.5
InstructionTasks with strict prompt rules.
51.8
53.2 best
MathMath problems.
43.9
50.5 best

Benchmarks

28 shared
Only o1: 1Only o4-mini: 28
o1
o4-mini
7.0%161 / 222
16.5% best122 / 222
65.0% best135 / 217
61.0%141 / 217
76.8%99 / 217
79.6% best91 / 217
0.3%137 / 214
0.6% best132 / 214
73.3%94 / 200
81.7% best83 / 200
74.7%121 / 199
78.4% best103 / 199
34.5% best70 / 164
24.8%106 / 164
80.4% best86 / 149
79.2%97 / 149
62.6% best84 / 149
55.6%89 / 149
70.3% best43 / 146
68.7%51 / 146
TaxEval v2Finance
74.3%38 / 143
74.8% best29 / 143
50.3%116 / 142
82.2% best53 / 142
75.7%77 / 141
77.6% best73 / 141
73.2%86 / 135
74.5% best83 / 135
MMLU ProKnowledge
83.5% best71 / 135
80.6%86 / 135
AIMEMath
71.5%53 / 95
83.7% best41 / 95
MedQAHealthcare
96.5% best1 / 95
96.0%8 / 95
MMMU ProMultimodal
77.4%53 / 92
79.7% best46 / 92
41.1% best50 / 91
18.8%80 / 91
Chess PuzzlesReasoning
10.0%79 / 90
13.0% best76 / 90