DeepSeek V3 vs LFM2.5-2.6B

Change models
DeepSeek V3DeepSeek
LFM2.5-2.6BLiquidAI
IndexAll categories, out of 100.
29.9 ±4.9 best
29.3 ±6.0
GapIndex points below the top.
Top
−0.6 · no clear gap
CoverageIndex weight that has results.
85%
85%
SpeedOutput tokens per second.
37/s
189/s best
EloLMArena rating and rank.
1333
—
ReleasedMonth of release.
2024-12
2026-08
Input / 1MUS dollars per 1M input tokens.
$0.27 best
$0.35
Output / 1MUS dollars per 1M output tokens.
$1.10
$0.50 best
1K chats2K tokens in, 500 out, each.
$1.09
$0.95 best
1K documents20K tokens in, 1K out, each.
$6.50 best
$7.50
1K agent tasks200K tokens in, 20K out, each.
$76.00 best
$80.00
ContextMaximum tokens in one request.
128K
128K
AgenticMulti-step tasks with tools.
26.0
32.0 best
CodingCode writing and repair.
31.1 best
23.9
ReasoningLogic problems and puzzles.
34.1 best
24.0
MultimodalTasks with images and text.
—
—
KnowledgeFacts and expert knowledge.
34.3 best
29.5
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
29.1
44.3 best
MathMath problems.
27.2
27.2

Benchmarks

6 shared
Only DeepSeek V3: 28Only LFM2.5-2.6B: 7
DeepSeek V3
LFM2.5-2.6B
2.9%220 / 222
6.2% best169 / 222
29.3% best183 / 217
5.7%202 / 217
0.0%150 / 214
0.0%150 / 214
55.7%168 / 199
55.8% best167 / 199
0.0%101 / 133
0.0%101 / 133
35.8% best100 / 114
14.4%114 / 114