Meta
availableShows if the model has enough results for an index.Llama 3.1 405B
Llama 3.1 405B is a non-reasoning model from Meta. 11 benchmarks count toward its score, in 5 categories.
IndexOverall score out of 100.26.7 ±8.4
CoverageShare of the index weight with results.65%
SpeedOutput tokens per second.29/s
Input / 1MUS dollars per 1M input tokens.Free
Output / 1MUS dollars per 1M output tokens.Free
ContextMaximum tokens in one request.128K
EloLMArena rating and rank.N/A
The index is a score out of 100. The ± range shows how much it can change.
CapabilitiesScore per category, out of 100.
Out of 100Results
11 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| Artificial Analysis GPQA Diamond | Knowledge | 51.5% | 21.3 | — | — | Artificial Analysis |
| GPQA diamond | Knowledge | 50.9% | 25.3 | — | — | Epoch AI |
| MATH level 5 | Math | 49.8% | 23.1 | — | — | Epoch AI |
| Artificial Analysis IFBench | Instruction | 39.0% | 28.7 | — | — | Artificial Analysis |
| Artificial Analysis Long Context Reasoning | Reasoning | 25.3% | 25.8 | — | — | Artificial Analysis |
| Artificial Analysis Omniscience Accuracy | Knowledge | 23.2% | 42.6 | — | — | Artificial Analysis |
| τ²-Bench Tool-Agent-User Evaluation | Agentic | 19.0% | 12.5 | — | — | Victor Barres et al. |
| OTIS Mock AIME 2024-2025 | Math | 9.7% | 17.1 | — | — | Epoch AI |
| Artificial Analysis Intelligence Index | Knowledge | 7.3% | 31.5 | — | — | Artificial Analysis |
| Artificial Analysis Humanity's Last Exam | Knowledge | 4.0% | 28.9 | — | — | Artificial Analysis |
| Critical Physics Tasks | Reasoning | 0.0% | 38.4 | — | — | Artificial Analysis |
11 benchmarks count, from 11 of 11 results. A grey row does not count. Too few models took that benchmark.