Claude 3.7 Sonnet vs Claude 3.7 Sonnet Thinking

Change models
IndexAll categories, out of 100.
37.7 ±4.0
41.4 ±4.7 best
GapIndex points below the top.
−3.7 · no clear gap
Top
CoverageIndex weight that has results.
95%
95%
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
1299
—
ReleasedMonth of release.
2025-02
2025-02
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
200K
200K
AgenticMulti-step tasks with tools.
40.7 best
39.1
CodingCode writing and repair.
42.1 best
39.5
ReasoningLogic problems and puzzles.
39.8 best
38.6
MultimodalTasks with images and text.
40.3
48.1 best
KnowledgeFacts and expert knowledge.
40.0
44.1 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
38.1
42.5 best
MathMath problems.
30.0
36.6 best

Benchmarks

22 shared
Only Claude 3.7 Sonnet: 20Only Claude 3.7 Sonnet Thinking: 2
Claude 3.7 Sonnet
Claude 3.7 Sonnet Thinking
4.2%194 / 222
9.7% best148 / 222
0.0%150 / 214
0.9% best124 / 214
65.6%142 / 199
77.2% best107 / 199
28.2% best84 / 164
28.0%87 / 164
80.0%91 / 149
82.5% best69 / 149
50.0%96 / 149
54.7% best91 / 149
44.0%90 / 146
48.3% best82 / 146
TaxEval v2Finance
72.4%62 / 143
74.0% best42 / 143
56.7%111 / 142
60.4% best106 / 142
68.0%98 / 141
78.2% best72 / 141
67.4%100 / 135
75.3% best81 / 135
MMLU ProKnowledge
80.7%85 / 135
82.7% best76 / 135
68.7% best11 / 97
66.9%31 / 97
AIMEMath
22.3%79 / 95
44.6% best64 / 95
MMMU ProMultimodal
71.5%68 / 92
75.1% best56 / 92
MGSMMultilingual
92.4%18 / 74
93.0% best11 / 74
90.8%25 / 70
93.2% best15 / 70
76.8%43 / 59
91.6% best21 / 59
71.8%17 / 28
75.0% best14 / 28
23.3%26 / 27
61.3% best21 / 27