Llama 3.1 70B vs Nova Pro

Change models
Nova ProAmazon
IndexAll categories, out of 100.
24.8 ±5.3
25.6 ±9.2 best
GapIndex points below the top.
−0.8 · no clear gap
Top
CoverageIndex weight that has results.
90% best
65%
SpeedOutput tokens per second.
—
129/s
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2024-07
2024-12
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
128K
128K
AgenticMulti-step tasks with tools.
17.1 best
12.1
CodingCode writing and repair.
21.4
—
ReasoningLogic problems and puzzles.
23.7
29.3 best
MultimodalTasks with images and text.
—
12.8
KnowledgeFacts and expert knowledge.
27.6 best
27.5
MultilingualTasks in many languages.
41.0
—
InstructionTasks with strict prompt rules.
27.8 best
24.6
MathMath problems.
13.9
—

Benchmarks

6 shared
Only Llama 3.1 70B: 14Only Nova Pro: 2
Llama 3.1 70B
Nova Pro
3.6% best210 / 222
3.2%217 / 222
4.7%203 / 217
21.0% best192 / 217
0.0%150 / 214
0.0%150 / 214
49.1%176 / 199
49.9% best173 / 199
21.6% best127 / 149
14.0%142 / 149
29.0%136 / 146
38.1% best113 / 146