EuroLLM 9B Instruct 2512

  • Input: text
UnrankedEnough results for an index.
IndexAll categories, out of 100.UnrankedMedian 50.7
CoverageIndex weight that has results.5%
SpeedOutput tokens per second.—Median 76/s
First tokenSeconds to the first output token.—Median 1.1 s
Input / 1MUS dollars per 1M input tokens.—Median $0.60
Output / 1MUS dollars per 1M output tokens.—Median $2.50
ContextMaximum tokens in one request.—Median 262K
EloLMArena rating and rank.—Median 1425

Capabilities

Index per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None counted——
CodingCode writing and repair.None counted——
ReasoningLogic problems and puzzles.None counted——
MultimodalTasks with images and text.None counted——
KnowledgeFacts and expert knowledge.None counted——
MultilingualTasks in many languages.1 counted31.6—
InstructionTasks with strict prompt rules.None counted——
MathMath problems.None counted——

Results

1 counted
BenchmarkResultThe score from the source.PlacePlace among results on this benchmark.
EuroEval DutchMultilingual47.1% ±0.685 / 192
EuroEval PortugueseMultilingual46.1% ±0.691 / 199
EuroEval ItalianMultilingual45.0% ±0.791 / 191
EuroEval FrenchMultilingual49.7% ±0.593 / 195
EuroEval SwedishMultilingual42.2% ±0.9107 / 213
EuroEval GermanMultilingual35.5% ±0.6109 / 208
EuroEval SpanishMultilingual35.4% ±0.7108 / 194
EuroEval PolishMultilingual39.1% ±0.7128 / 227

Sources

BenchLMCC BY-NC 4.0EuroEvalMIT