Claude 3.7 Sonnet Thinking vs LFM3-1.7B

Change models
LFM3-1.7BLiquidAI
IndexAll categories, out of 100.
41.4 ±4.7
41.5 ±6.5 best
GapIndex points below the top.
−0.1 · no clear gap
Top
CoverageIndex weight that has results.
95% best
75%
SpeedOutput tokens per second.
—
218/s
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2025-02
2026-10
Input / 1MUS dollars per 1M input tokens.
—
$0.08
Output / 1MUS dollars per 1M output tokens.
—
$0.20
1K chats2K tokens in, 500 out, each.
—
$0.26
1K documents20K tokens in, 1K out, each.
—
$1.80
1K agent tasks200K tokens in, 20K out, each.
—
$20.00
ContextMaximum tokens in one request.
200K
262K best
AgenticMulti-step tasks with tools.
39.1
46.4 best
CodingCode writing and repair.
39.5 best
37.0
ReasoningLogic problems and puzzles.
38.6
43.5 best
MultimodalTasks with images and text.
48.1
—
KnowledgeFacts and expert knowledge.
44.1 best
28.8
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
42.5
57.6 best
MathMath problems.
36.6
—

Benchmarks

3 shared
Only Claude 3.7 Sonnet Thinking: 21Only LFM3-1.7B: 22
Claude 3.7 Sonnet Thinking
LFM3-1.7B
28.0% best87 / 164
7.1%164 / 164
78.2% best72 / 141
63.4%107 / 141
93.2%15 / 70
96.7% best2 / 70