LFM2.5-24B-A2B vs o3-mini

Change models
LFM2.5-24B-A2BLiquidAI
o3-miniOpenAI
IndexAll categories, out of 100.
39.8 ±7.9
40.0 ±4.9 best
GapIndex points below the top.
−0.2 · no clear gap
Top
CoverageIndex weight that has results.
70%
85% best
SpeedOutput tokens per second.
280/s best
173/s
EloLMArena rating and rank.
—
1320
ReleasedMonth of release.
2026-10
2025-01
Input / 1MUS dollars per 1M input tokens.
$0.05 best
$1.10
Output / 1MUS dollars per 1M output tokens.
$0.70 best
$4.40
1K chats2K tokens in, 500 out, each.
$0.45 best
$4.40
1K documents20K tokens in, 1K out, each.
$1.70 best
$26.40
1K agent tasks200K tokens in, 20K out, each.
$24.00 best
$308.00
ContextMaximum tokens in one request.
128K
200K best
AgenticMulti-step tasks with tools.
32.0 best
21.8
CodingCode writing and repair.
38.7 best
37.1
ReasoningLogic problems and puzzles.
—
43.2
MultimodalTasks with images and text.
—
—
KnowledgeFacts and expert knowledge.
38.6
39.0 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
58.4 best
52.3
MathMath problems.
45.6
46.1 best

Benchmarks

3 shared
Only LFM2.5-24B-A2B: 10Only o3-mini: 35
LFM2.5-24B-A2B
o3-mini
74.4%84 / 141
77.2% best75 / 141
51.0% best95 / 114
49.3%97 / 114
96.8% best1 / 70
93.9%10 / 70