Claude 3.5 Haiku vs Claude 3.5 Sonnet

Change models
IndexAll categories, out of 100.
24.1 ±3.4
32.2 ±9.2 best
GapIndex points below the top.
−8.1 · no clear gap
Top
CoverageIndex weight that has results.
100% best
55%
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
1255
1298 best
ReleasedMonth of release.
2024-10
2024-06
Input / 1MUS dollars per 1M input tokens.
—
$3.00
Output / 1MUS dollars per 1M output tokens.
—
$15.00
1K chats2K tokens in, 500 out, each.
—
$13.50
1K documents20K tokens in, 1K out, each.
—
$75.00
1K agent tasks200K tokens in, 20K out, each.
—
$900.00
ContextMaximum tokens in one request.
200K
200K
AgenticMulti-step tasks with tools.
26.6
—
CodingCode writing and repair.
28.0
34.0 best
ReasoningLogic problems and puzzles.
31.4
—
MultimodalTasks with images and text.
14.5
44.7 best
KnowledgeFacts and expert knowledge.
24.4
37.4 best
MultilingualTasks in many languages.
31.1
—
InstructionTasks with strict prompt rules.
32.6
—
MathMath problems.
16.2
25.2 best

Benchmarks

15 shared
Only Claude 3.5 Haiku: 18Only Claude 3.5 Sonnet: 12
Claude 3.5 Haiku
Claude 3.5 Sonnet
38.1%178 / 217
54.0% best138 / 217
4.3%174 / 200
6.5% best165 / 200
TaxEval v2Finance
57.4%135 / 143
70.2% best93 / 143
41.9%127 / 142
49.6% best117 / 142
41.6%131 / 141
59.4% best111 / 141
37.9%129 / 135
59.3% best110 / 135
MMLU ProKnowledge
64.1%129 / 135
78.4% best103 / 135
CorpFin v2Finance
50.8%106 / 131
53.6% best98 / 131
40.6%108 / 114
49.0% best100 / 114
AIMEMath
3.3%93 / 95
10.0% best88 / 95
46.4%53 / 88
51.7% best47 / 88
MGSMMultilingual
84.6%68 / 74
92.6% best15 / 74
0.3%64 / 69
1.0% best59 / 69
0.0%33 / 64
0.0%33 / 64
64.2%56 / 59
72.4% best49 / 59