Llama 3.1-70B

Llama 3.1-70B is a model from Meta. 4 benchmarks count toward its score, in 3 categories.

partialShows if the model has enough results for an index.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.30%
SpeedOutput tokens per second.
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.N/A
EloLMArena rating and rank.N/A

The index is a score out of 100. The ± range shows how much it can change.

CapabilitiesScore per category, out of 100.

Out of 100
AgenticMulti-step tasks with tools.
N/A
CodingCode writing and repair.
N/A
ReasoningLogic problems and puzzles.
N/A
MultimodalTasks with images and text.
N/A
KnowledgeFacts and expert knowledge.
19.0
MultilingualTasks in many languages.
74.1
InstructionTasks with strict rules in the prompt.
N/A
MathMath problems.
15.2

Results

4 counted
BenchmarkThe test name.CategoryThe capability that the test measures.ResultThe score from the publisher.IndexThis result as a score out of 100.RunThe settings of the run.DateDate of the result.Published byThe source of the result.
EuroEval PortugueseMultilingual59.3%76.3EuroEval
EuroEval FrenchMultilingual58.4%75.3EuroEval
EuroEval PolishMultilingual56.5%72.9EuroEval
EuroEval GermanMultilingual52.1%67.3EuroEval
GPQA diamondKnowledge44.2%19.0Epoch AI
MATH level 5Math36.7%16.7Epoch AI
OTIS Mock AIME 2024-2025Math3.6%13.7Epoch AI

4 benchmarks count, from 7 of 7 results. A grey row does not count. Too few models took that benchmark.

Sources

BenchLM benchmark aggregationUsed with attribution; per-benchmark results credited to their original authorsEuroEval, collected directlyMIT — the leaderboard site and its CSV routes are in the licensed repositoryEpoch AI, collected directlyCC BY — free to use and redistribute with attribution

More from Meta

Muse Spark 1.375.0Muse Spark 1.269.2Muse Spark 1.167.0Muse Spark61.6Muse Glimmer 30B53.5