Mistral Large 2411

  • Input: text
UnrankedEnough results for an index.
IndexAll categories, out of 100.UnrankedMedian 50.7
CoverageIndex weight that has results.45%
SpeedOutput tokens per second.—Median 76/s
First tokenSeconds to the first output token.—Median 1.1 s
Input / 1MUS dollars per 1M input tokens.—Median $0.60
Output / 1MUS dollars per 1M output tokens.—Median $2.50
ContextMaximum tokens in one request.—Median 262K
EloLMArena rating and rank.1265±4 #294Median 1425

Capabilities

Index per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None counted——
CodingCode writing and repair.1 counted20.3—
ReasoningLogic problems and puzzles.None counted——
MultimodalTasks with images and text.None counted——
KnowledgeFacts and expert knowledge.2 counted26.6—
MultilingualTasks in many languages.None counted——
InstructionTasks with strict prompt rules.None counted——
MathMath problems.2 counted21.3—

Results

5 counted
BenchmarkResultThe score from the source.PlacePlace among results on this benchmark.
MATH 500Math74.4% ±3.845 / 59
MMLU ProKnowledge69.7% ±0.4119 / 135
GPQA Diamond · Vals AIKnowledge47.7% ±2.5123 / 135
LiveCodeBenchCoding37.1% ±1.1132 / 142
AIMEMath9.2% ±1.190 / 95
MGSMMultilingual87.2% ±2.060 / 74
MedQAHealthcare76.2% ±0.878 / 95
TaxEval v2Finance63.8% ±0.9118 / 143

Sources

BenchLMCC BY-NC 4.0Vals AINo licence stated

More from Mistral

All models
Mistral Large 460.1Mistral Medium 3.5 128B49.7Mistral Medium 3.542.4Mistral Small 438.0Mistral Large 334.4