Meta
partialShows if the model has enough results for an index.Llama 3.1 8B Instruct
Llama 3.1 8B Instruct is a model from Meta. 1 benchmark counts toward its score, in 1 category.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.5%
SpeedOutput tokens per second.27/s
Input / 1MUS dollars per 1M input tokens.$0.05
Output / 1MUS dollars per 1M output tokens.$0.08
ContextMaximum tokens in one request.131K
EloLMArena rating and rank.1186 (#313)
The index is a score out of 100. The ± range shows how much it can change.
49,605 votes. Elo shows what people prefer. It does not change the score.
CapabilitiesScore per category, out of 100.
Out of 100Results
1 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| EuroEval Dutch | Multilingual | 46.8% | 60.8 | — | — | EuroEval |
| EuroEval French | Multilingual | 46.7% | 60.6 | — | — | EuroEval |
| EuroEval Swedish | Multilingual | 43.0% | 56.0 | — | — | EuroEval |
| EuroEval Portuguese | Multilingual | 42.4% | 55.3 | — | — | EuroEval |
| EuroEval Italian | Multilingual | 40.9% | 53.4 | — | — | EuroEval |
| EuroEval Polish | Multilingual | 40.8% | 53.3 | — | — | EuroEval |
| EuroEval Spanish | Multilingual | 38.6% | 50.5 | — | — | EuroEval |
| EuroEval German | Multilingual | 37.0% | 48.5 | — | — | EuroEval |
1 benchmarks count, from 8 of 8 results. A grey row does not count. Too few models took that benchmark.