GPT-4o vs LFM2.5-2.6B

Change models
GPT-4oOpenAI
LFM2.5-2.6BLiquidAI
IndexAll categories, out of 100.
28.7 ±3.3
29.3 ±6.0 best
GapIndex points below the top.
−0.6 · no clear gap
Top
CoverageIndex weight that has results.
100% best
85%
SpeedOutput tokens per second.
66/s
189/s best
EloLMArena rating and rank.
1300
—
ReleasedMonth of release.
2024-05
2026-08
Input / 1MUS dollars per 1M input tokens.
$2.50
$0.35 best
Output / 1MUS dollars per 1M output tokens.
$10.00
$0.50 best
Batch output / 1MBatch price per 1M output tokens.
$5.00
—
1K chats2K tokens in, 500 out, each.
$10.00
$0.95 best
1K documents20K tokens in, 1K out, each.
$60.00
$7.50 best
1K agent tasks200K tokens in, 20K out, each.
$700.00
$80.00 best
ContextMaximum tokens in one request.
128K
128K
AgenticMulti-step tasks with tools.
26.7
32.0 best
CodingCode writing and repair.
22.8
23.9 best
ReasoningLogic problems and puzzles.
37.4 best
24.0
MultimodalTasks with images and text.
36.0
—
KnowledgeFacts and expert knowledge.
34.1 best
29.5
MultilingualTasks in many languages.
30.8
—
InstructionTasks with strict prompt rules.
21.1
44.3 best
MathMath problems.
23.4
27.2 best

Benchmarks

5 shared
Only GPT-4o: 37Only LFM2.5-2.6B: 8
GPT-4o
LFM2.5-2.6B
2.4%222 / 222
6.2% best169 / 222
49.3% best158 / 217
5.7%202 / 217
0.0%150 / 214
0.0%150 / 214
54.3%169 / 199
55.8% best167 / 199
0.0%101 / 133
0.0%101 / 133