Grok 3 [Beta] vs Grok 4

Change models
IndexAll categories, out of 100.
39.3 ±8.5
50.0 ±4.0 best
GapIndex points below the top.
−10.7
Top
CoverageIndex weight that has results.
60%
95% best
SpeedOutput tokens per second.
—
78/s
EloLMArena rating and rank.
—
1411
ReleasedMonth of release.
2025-02
2025-07
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
128K
128K
AgenticMulti-step tasks with tools.
—
48.0
CodingCode writing and repair.
34.9
50.9 best
ReasoningLogic problems and puzzles.
34.4
47.3 best
MultimodalTasks with images and text.
—
49.6
KnowledgeFacts and expert knowledge.
47.1
55.8 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
—
39.2
MathMath problems.
38.2
50.5 best

Benchmarks

15 shared
Only Grok 3 [Beta]: 11Only Grok 4: 25
Grok 3 [Beta]
Grok 4
75.8%103 / 217
87.0% best64 / 217
55.6%116 / 200
84.0% best77 / 200
82.6%67 / 149
83.2% best57 / 149
TaxEval v2Finance
75.9% best10 / 143
65.1%116 / 143
52.9%114 / 142
83.2% best49 / 142
74.2%85 / 135
88.1% best35 / 135
MMLU ProKnowledge
79.9%91 / 135
85.3% best58 / 135
CorpFin v2Finance
59.7%74 / 131
66.0% best23 / 131
AIMEMath
58.8%58 / 95
90.6% best27 / 95
MedQAHealthcare
83.8%63 / 95
92.5% best30 / 95
MGSMMultilingual
91.3% best28 / 74
90.9%31 / 74
3.8%50 / 69
19.7% best31 / 69
89.8%27 / 59
96.2% best2 / 59
0.0%45 / 55
2.1% best35 / 55
0.0%3 / 36
0.0%3 / 36