Claude Sonnet 4 vs Mistral Medium 3.5

Change models
IndexAll categories, out of 100.
43.0 ±5.2 best
42.7 ±8.9
GapIndex points below the top.
Top
−0.3 · no clear gap
CoverageIndex weight that has results.
90% best
65%
SpeedOutput tokens per second.
49/s
92/s best
EloLMArena rating and rank.
1339
1421 best
ReleasedMonth of release.
2025-05
2026-04
Input / 1MUS dollars per 1M input tokens.
$3.00
$1.50 best
Output / 1MUS dollars per 1M output tokens.
$15.00
$7.50 best
Batch output / 1MBatch price per 1M output tokens.
—
$3.75
1K chats2K tokens in, 500 out, each.
$13.50
$6.75 best
1K documents20K tokens in, 1K out, each.
$75.00
$37.50 best
1K agent tasks200K tokens in, 20K out, each.
$900.00
$450.00 best
ContextMaximum tokens in one request.
200K
262K best
AgenticMulti-step tasks with tools.
49.4 best
47.1
CodingCode writing and repair.
46.2
47.1 best
ReasoningLogic problems and puzzles.
38.9
—
MultimodalTasks with images and text.
49.4
—
KnowledgeFacts and expert knowledge.
44.5 best
24.3
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
—
—
MathMath problems.
38.9
50.3 best

Benchmarks

7 shared
Only Claude Sonnet 4: 23Only Mistral Medium 3.5: 16
Claude Sonnet 4
Mistral Medium 3.5
TaxEval v2Finance
69.6% best97 / 143
68.0%103 / 143
69.4% best95 / 135
34.8%131 / 135
MMLU ProKnowledge
79.4% best95 / 135
75.3%109 / 135
CorpFin v2Finance
54.7%92 / 131
58.8% best82 / 131
MedScribeHealthcare
72.4% best88 / 109
67.7%99 / 109
MedCodeHealthcare
33.9% best82 / 106
33.8%83 / 106
62.5% best54 / 97
28.9%94 / 97