Claude 3 Haiku vs Gemini 1.5 Flash
Change modelsClaude 3 HaikuAnthropic
Gemini 1.5 FlashGoogle
IndexAll categories, out of 100.
22.0 ±5.4 best
20.2 ±9.6
GapIndex points below the top.
Top
−1.8 · no clear gap
CoverageIndex weight that has results.
95% best
55%
SpeedOutput tokens per second.
73/s
—
EloLMArena rating and rank.
1195
—
ReleasedMonth of release.
2024-03
2024-05
Input / 1MUS dollars per 1M input tokens.
$0.25
—
Output / 1MUS dollars per 1M output tokens.
$1.25
—
1K chats2K tokens in, 500 out, each.
$1.13
—
1K documents20K tokens in, 1K out, each.
$6.25
—
1K agent tasks200K tokens in, 20K out, each.
$75.00
—
ContextMaximum tokens in one request.
200K
1M best
AgenticMulti-step tasks with tools.
16.8
—
CodingCode writing and repair.
31.2 best
8.3
ReasoningLogic problems and puzzles.
31.6
—
MultimodalTasks with images and text.
5.0
21.6 best
KnowledgeFacts and expert knowledge.
24.1 best
22.3
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
22.8
—
MathMath problems.
8.1
18.0 best
Benchmarks
6 sharedOnly Claude 3 Haiku: 6Only Gemini 1.5 Flash: 7
Claude 3 Haiku
Gemini 1.5 Flash