Inference
EN
Meta

Llama 3.1 70B Instruct

Llama 3.1 70B Instruct is a model from Meta. It has no scored result.

  • Open weights
  • Input: text
  • Released 2024-07
No resultsEnough results for an index.
IndexAll categories, out of 100.UnrankedMedian 51.0
CoverageIndex weight that has results.0%
SpeedOutput tokens per second.70/sMedian 67/s
First tokenSeconds to the first output token.0.4 sMedian 1.3 s
Input / 1MUS dollars per 1M input tokens.$0.72Median $0.60
Output / 1MUS dollars per 1M output tokens.$0.72Median $2.55
ContextMaximum tokens in one request.131KMedian 262K
EloLMArena rating and rank.1261±4 #295Median 1422

Details

From OpenRouter
API IDThe model ID on OpenRouter.
meta-llama/llama-3.1-70b-instruct
Max outputMaximum output tokens per request.
8K
Knowledge cutoffLast date of training data.
31 Dec 2023
ToolsTool calls on OpenRouter.
No
JSON outputOutput follows a given JSON schema.
No
Cache read / 1MUS dollars per 1M cached tokens.
—
WeightsLink to the published weights.
Hugging Face (opens in a new tab) ↗
RetiresDate OpenRouter removes the model.
—

Where to run

APIs that serve this model.
2 providers
ProviderTypeMaker, cloud, host or router.InputOutputContext
Amazon BedrockDeprecatedCloud$0.72$0.72128K
OpenRouterRouter$0.72$0.72131K

US dollars per 1M tokens, list price. From models.dev (opens in a new tab) (MIT).

Capabilities

Index per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None counted——
CodingCode writing and repair.None counted——
ReasoningLogic problems and puzzles.None counted——
MultimodalTasks with images and text.None counted——
KnowledgeFacts and expert knowledge.None counted——
MultilingualTasks in many languages.None counted——
InstructionTasks with strict prompt rules.None counted——
MathMath problems.None counted——

Results

0 counted
This model has no scored result.

Sources

BenchLMCC BY-NC 4.0OpenRouterTerms restrict reusemodels.devMIT

History

5 releases
Output / 1M$0.40 → $0.72
23 Oct 202612 Nov 2026

Questions

How much does Llama 3.1 70B Instruct cost?
$0.72 per 1M input tokens, $0.72 per 1M output tokens.
How fast is Llama 3.1 70B Instruct?
70 output tokens per second, 0.4 s to the first token.
What is the context window of Llama 3.1 70B Instruct?
131K tokens.
Is Llama 3.1 70B Instruct open source?
Yes. Its weights are published.
When was Llama 3.1 70B Instruct released?
July 2024.

More from Meta

All models
Llama 3.1 405B27.0Llama 3.1 70B24.8Llama 3.1 8B17.9Llama 3.1 8B InstructUnrankedLlama 3.2 1B InstructUnranked