North Mini Code

North Mini Code is a reasoning model from Cohere. 10 benchmarks count toward its score, in 5 categories.

availableShows if the model has enough results for an index.
IndexOverall score out of 100.38.3 ±7.6
CoverageShare of the index weight with results.75%
SpeedOutput tokens per second.96/s
Input / 1MUS dollars per 1M input tokens.Free
Output / 1MUS dollars per 1M output tokens.Free
ContextMaximum tokens in one request.256K
EloLMArena rating and rank.N/A

The index is a score out of 100. The ± range shows how much it can change. A free tier is available.

CapabilitiesScore per category, out of 100.

Out of 100
AgenticMulti-step tasks with tools.
30.6
CodingCode writing and repair.
46.7
ReasoningLogic problems and puzzles.
36.5
MultimodalTasks with images and text.
N/A
KnowledgeFacts and expert knowledge.
38.7
MultilingualTasks in many languages.
N/A
InstructionTasks with strict rules in the prompt.
47.5
MathMath problems.
N/A

Results

10 counted
BenchmarkThe test name.CategoryThe capability that the test measures.ResultThe score from the publisher.IndexThis result as a score out of 100.RunThe settings of the run.DateDate of the result.Published byThe source of the result.
Artificial Analysis GPQA DiamondKnowledge75.7%46.1Artificial Analysis
Artificial Analysis IFBenchInstruction57.6%47.5Artificial Analysis
Artificial Analysis SciCodeCoding38.8%46.7Artificial Analysis
τ²-Bench Tool-Agent-User EvaluationAgentic37.4%25.7Victor Barres et al.
Artificial Analysis Long Context ReasoningReasoning37.3%34.1Artificial Analysis
Artificial Analysis Omniscience AccuracyKnowledge18.9%37.3Artificial Analysis
Artificial Analysis Humanity's Last ExamKnowledge11.1%36.6Artificial Analysis
Artificial Analysis Intelligence IndexKnowledge9.9%34.8Artificial Analysis
Critical Physics TasksReasoning0.3%39.0Artificial Analysis
GDPval-AA normalizedAgentic0.0%35.6Artificial Analysis

10 benchmarks count, from 10 of 10 results. A grey row does not count. Too few models took that benchmark.

Sources

BenchLM benchmark aggregationUsed with attribution; per-benchmark results credited to their original authors

More from Cohere

Command A+41.8Command A22.0Command RUnrankedCommand R (08-2024)UnrankedCommand R PlusUnranked