JetBrains
partialShows if the model has enough results for an index.Mellum2-12B-A2.5B-Instruct
Mellum2-12B-A2.5B-Instruct is a non-reasoning model from JetBrains in the Mellum2 12B-A2.5B family. 6 benchmarks count toward its score, in 5 categories.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.65%
SpeedOutput tokens per second.—
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.128K
EloLMArena rating and rank.N/A
The index is a score out of 100. The ± range shows how much it can change.
CapabilitiesScore per category, out of 100.
Out of 100Results
6 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| MMLU-Redux | Knowledge | 78.1% | 27.3 | — | — | Qwen |
| Instruction-Following Eval | Instruction | 75.8% | 14.6 | — | — | Jeffrey Zhou et al. |
| Berkeley Function Calling Leaderboard v4 | Agentic | 44.2% | 28.5 | — | — | Arcee AI |
| Graduate-Level Google-Proof Q&A | Knowledge | 40.9% | 16.0 | — | — | David Rein et al. |
| GPQA Diamond | Knowledge | 40.9% | 16.0 | — | — | David Rein et al. |
| LiveCodeBench v6 | Coding | 37.2% | 10.9 | — | — | LiveCodeBench maintainers |
| EuroEval Dutch | Multilingual | 37.1% | 48.7 | — | — | EuroEval |
| EuroEval German | Multilingual | 31.9% | 42.2 | — | — | EuroEval |
6 benchmarks count, from 8 of 8 results. A grey row does not count. Too few models took that benchmark.