Devstral Small vs GPT-4o
Change modelsDevstral SmallMistral
GPT-4oOpenAI
IndexAll categories, out of 100.
28.2 ±8.2
28.7 ±3.3 best
GapIndex points below the top.
−0.5 · no clear gap
Top
CoverageIndex weight that has results.
75%
100% best
SpeedOutput tokens per second.
—
66/s
EloLMArena rating and rank.
—
1300
ReleasedMonth of release.
2025-05
2024-05
Input / 1MUS dollars per 1M input tokens.
—
$2.50
Output / 1MUS dollars per 1M output tokens.
—
$10.00
Batch output / 1MBatch price per 1M output tokens.
—
$5.00
1K chats2K tokens in, 500 out, each.
—
$10.00
1K documents20K tokens in, 1K out, each.
—
$60.00
1K agent tasks200K tokens in, 20K out, each.
—
$700.00
ContextMaximum tokens in one request.
128K
128K
AgenticMulti-step tasks with tools.
21.6
26.7 best
CodingCode writing and repair.
35.7 best
22.8
ReasoningLogic problems and puzzles.
28.5
37.4 best
MultimodalTasks with images and text.
—
36.0
KnowledgeFacts and expert knowledge.
24.2
34.1 best
MultilingualTasks in many languages.
—
30.8
InstructionTasks with strict prompt rules.
21.4 best
21.1
MathMath problems.
—
23.4
Benchmarks
7 sharedOnly Devstral Small: 1Only GPT-4o: 35
Devstral Small
GPT-4o