Gemma 4 E4B vs Mistral Medium 3

Change models
IndexAll categories, out of 100.
28.1 ±5.0 best
27.0 ±5.2
GapIndex points below the top.
Top
−1.1 · no clear gap
CoverageIndex weight that has results.
90%
95% best
SpeedOutput tokens per second.
—
76/s
EloLMArena rating and rank.
—
1370
ReleasedMonth of release.
2026-04
2025-05
Input / 1MUS dollars per 1M input tokens.
—
$0.40
Output / 1MUS dollars per 1M output tokens.
—
$2.00
1K chats2K tokens in, 500 out, each.
—
$1.80
1K documents20K tokens in, 1K out, each.
—
$10.00
1K agent tasks200K tokens in, 20K out, each.
—
$120.00
ContextMaximum tokens in one request.
128K
131K best
AgenticMulti-step tasks with tools.
25.4 best
18.9
CodingCode writing and repair.
27.3 best
9.4
ReasoningLogic problems and puzzles.
30.8
32.7 best
MultimodalTasks with images and text.
32.1 best
23.9
KnowledgeFacts and expert knowledge.
30.1
31.1 best
MultilingualTasks in many languages.
9.0
—
InstructionTasks with strict prompt rules.
30.4 best
25.8
MathMath problems.
—
32.1

Benchmarks

8 shared
Only Gemma 4 E4B: 17Only Mistral Medium 3: 6
Gemma 4 E4B
Mistral Medium 3
3.8%202 / 222
4.1% best199 / 222
32.0% best177 / 217
31.3%179 / 217
0.6% best132 / 214
0.0%150 / 214
57.6%162 / 199
57.8% best161 / 199
20.8%130 / 149
24.3% best124 / 149
44.2% best88 / 146
39.3%107 / 146
51.4%102 / 113
53.0% best100 / 113
52.0% best51 / 59
30.3%58 / 59