Grok 4 vs Nemotron 3 Ultra

Change models
IndexAll categories, out of 100.
49.8 ±4.0
49.8 ±5.3
GapIndex points below the top.
Top
Top
CoverageIndex weight that has results.
95% best
80%
SpeedOutput tokens per second.
78/s
—
EloLMArena rating and rank.
1411
—
ReleasedMonth of release.
2025-07
2026-06
Input / 1MUS dollars per 1M input tokens.
—
Free
Output / 1MUS dollars per 1M output tokens.
—
Free
1K chats2K tokens in, 500 out, each.
—
Free
1K documents20K tokens in, 1K out, each.
—
Free
1K agent tasks200K tokens in, 20K out, each.
—
Free
ContextMaximum tokens in one request.
128K
1M best
AgenticMulti-step tasks with tools.
48.6 best
47.3
CodingCode writing and repair.
50.4
53.5 best
ReasoningLogic problems and puzzles.
46.8
49.4 best
MultimodalTasks with images and text.
49.1
—
KnowledgeFacts and expert knowledge.
55.5 best
50.0
MultilingualTasks in many languages.
—
52.0
InstructionTasks with strict prompt rules.
39.1
64.0 best
MathMath problems.
50.0
—

Benchmarks

8 shared
Only Grok 4: 32Only Nemotron 3 Ultra: 24
Grok 4
Nemotron 3 Ultra
26.7%92 / 216
28.4% best86 / 216
68.0% best120 / 211
67.0%125 / 211
2.0%102 / 207
3.1% best93 / 207
87.7% best52 / 193
86.7%59 / 193
40.5% best52 / 170
21.6%124 / 170
74.9%72 / 143
83.3% best60 / 143
53.7%69 / 140
81.4% best2 / 140
31.6% best81 / 120
27.3%95 / 120