Grok 4 vs Mistral Medium 3.5 128B

Change models
IndexAll categories, out of 100.
49.9 ±4.0
50.2 ±6.0 best
GapIndex points below the top.
−0.3 · no clear gap
Top
CoverageIndex weight that has results.
95% best
85%
SpeedOutput tokens per second.
78/s
—
EloLMArena rating and rank.
1411
—
ReleasedMonth of release.
2025-07
2026-04
Input / 1MUS dollars per 1M input tokens.
—
$1.50
Output / 1MUS dollars per 1M output tokens.
—
$7.50
1K chats2K tokens in, 500 out, each.
—
$6.75
1K documents20K tokens in, 1K out, each.
—
$37.50
1K agent tasks200K tokens in, 20K out, each.
—
$450.00
ContextMaximum tokens in one request.
128K
256K best
AgenticMulti-step tasks with tools.
47.9
59.9 best
CodingCode writing and repair.
50.8
53.3 best
ReasoningLogic problems and puzzles.
47.3 best
45.8
MultimodalTasks with images and text.
49.5 best
39.6
KnowledgeFacts and expert knowledge.
55.7 best
41.2
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
39.3
53.3 best
MathMath problems.
50.4
—

Benchmarks

9 shared
Only Grok 4: 31Only Mistral Medium 3.5 128B: 4
Grok 4
Mistral Medium 3.5 128B
26.7% best95 / 222
13.8%130 / 222
68.0%125 / 217
69.3% best115 / 217
2.0% best105 / 214
0.0%150 / 214
87.7% best55 / 199
74.8%119 / 199
40.5% best49 / 165
23.0%117 / 165
74.9%75 / 149
94.2% best26 / 149
53.7%73 / 146
68.8% best49 / 146
68.8% best79 / 113
64.9%84 / 113
42.3% best33 / 52
39.1%40 / 52