Meta
UnrankedEnough results for an index.Llama 3.1 8B Instruct
Llama 3.1 8B Instruct is a model from Meta. It has 1 scored result in 1 category. It has no index.
IndexAll categories, out of 100.UnrankedMedian 51.0
CoverageIndex weight that has results.5%
SpeedOutput tokens per second.28/sMedian 67/s
First tokenSeconds to the first output token.1.0 sMedian 1.3 s
Input / 1MUS dollars per 1M input tokens.$0.02Median $0.60
Output / 1MUS dollars per 1M output tokens.$0.04Median $2.55
ContextMaximum tokens in one request.131KMedian 262K
EloLMArena rating and rank.1187±4 #332Median 1422
Details
From OpenRouter- API IDThe model ID on OpenRouter.
meta-llama/llama-3.1-8b-instruct- Max outputMaximum output tokens per request.
- 16K
- Knowledge cutoffLast date of training data.
- 31 Dec 2023
- ToolsTool calls on OpenRouter.
- Yes
- JSON outputOutput follows a given JSON schema.
- Yes
- Cache read / 1MUS dollars per 1M cached tokens.
- —
- WeightsLink to the published weights.
- Hugging Face (opens in a new tab) ↗
- RetiresDate OpenRouter removes the model.
- —
Where to run
APIs that serve this model.ProviderTypeMaker, cloud, host or router.InputOutputContext
US dollars per 1M tokens, list price. From models.dev (opens in a new tab) (MIT).
Capabilities
Index per category, out of 100.Results
1 countedBenchmarkThe benchmark name.ResultThe score from the source.PlacePlace among results on this benchmark.
Sources
BenchLMCC BY-NC 4.0OpenRouterTerms restrict reuseEuroEvalMITmodels.devMITHistory
5 releases23 Oct 202612 Nov 2026
Questions
- How much does Llama 3.1 8B Instruct cost?
- $0.02 per 1M input tokens, $0.04 per 1M output tokens.
- How fast is Llama 3.1 8B Instruct?
- 28 output tokens per second, 1.0 s to the first token.
- What is the context window of Llama 3.1 8B Instruct?
- 131K tokens.
- Is Llama 3.1 8B Instruct open source?
- Yes. Its weights are published.
- When was Llama 3.1 8B Instruct released?
- July 2024.