GPT-4.1 nano vs Llama 4 Scout

Change models
IndexAll categories, out of 100.
26.3 ±3.9
26.8 ±4.8 best
GapIndex points below the top.
−0.5 · no clear gap
Top
CoverageIndex weight that has results.
95%
95%
SpeedOutput tokens per second.
56/s
63/s best
EloLMArena rating and rank.
1285
—
ReleasedMonth of release.
2025-04
2025-04
Input / 1MUS dollars per 1M input tokens.
$0.10
$0.10
Output / 1MUS dollars per 1M output tokens.
$0.40
$0.30 best
Batch output / 1MBatch price per 1M output tokens.
$0.20
—
1K chats2K tokens in, 500 out, each.
$0.40
$0.35 best
1K documents20K tokens in, 1K out, each.
$2.40
$2.30 best
1K agent tasks200K tokens in, 20K out, each.
$28.00
$26.00 best
ContextMaximum tokens in one request.
1.05M
1.31M best
AgenticMulti-step tasks with tools.
24.2 best
23.6
CodingCode writing and repair.
24.8 best
23.6
ReasoningLogic problems and puzzles.
31.6
32.4 best
MultimodalTasks with images and text.
17.1
24.0 best
KnowledgeFacts and expert knowledge.
26.7
28.0 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
24.8
25.9 best
MathMath problems.
29.1 best
24.2

Benchmarks

17 shared
Only GPT-4.1 nano: 18Only Llama 4 Scout: 1
GPT-4.1 nano
Llama 4 Scout
3.8%202 / 222
3.8%202 / 222
20.3%193 / 217
27.7% best184 / 217
48.9%149 / 217
51.8% best141 / 217
0.0%150 / 214
0.0%150 / 214
28.9% best136 / 200
7.8%160 / 200
51.2%172 / 199
58.7% best160 / 199
17.3% best137 / 149
15.5%139 / 149
32.0%129 / 146
39.5% best106 / 146
0.0%101 / 133
0.0%101 / 133
0.0%120 / 131
0.0%120 / 131
0.0%126 / 126
0.5% best125 / 126
0.0%102 / 122
0.0%102 / 122
1.8%116 / 116
2.4% best115 / 116
40.1%110 / 113
52.9% best101 / 113
70.0% best33 / 88
62.3%41 / 88
1.0% best59 / 69
0.0%68 / 69
0.0%33 / 64
0.0%33 / 64