Gemini 2.5 Flash-Lite vs Phi-4-reasoning

Change models
IndexAll categories, out of 100.
27.1 ±5.2
27.1 ±6.4
GapIndex points below the top.
Top
Top
CoverageIndex weight that has results.
95% best
85%
SpeedOutput tokens per second.
140/s best
41/s
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2025-07
2025-04
Input / 1MUS dollars per 1M input tokens.
$0.10
—
Output / 1MUS dollars per 1M output tokens.
$0.40
—
1K chats2K tokens in, 500 out, each.
$0.40
—
1K documents20K tokens in, 1K out, each.
$2.40
—
1K agent tasks200K tokens in, 20K out, each.
$28.00
—
ContextMaximum tokens in one request.
1.05M best
32K
AgenticMulti-step tasks with tools.
15.4 best
5.0
CodingCode writing and repair.
24.5
34.0 best
ReasoningLogic problems and puzzles.
33.1 best
22.1
MultimodalTasks with images and text.
33.2
—
KnowledgeFacts and expert knowledge.
27.1
33.3 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
18.5
21.1 best
MathMath problems.
26.0
35.5 best

Benchmarks

8 shared
Only Gemini 2.5 Flash-Lite: 7Only Phi-4-reasoning: 4
Gemini 2.5 Flash-Lite
Phi-4-reasoning
3.7%208 / 222
3.8% best202 / 222
32.0% best177 / 217
0.0%204 / 217
0.0%150 / 214
0.0%150 / 214
47.4%179 / 199
57.5% best163 / 199
19.0% best134 / 149
0.0%148 / 149
31.5% best131 / 146
23.5%142 / 146
64.6%104 / 141
65.8% best101 / 141
49.8%42 / 53
62.9% best39 / 53