WizardLM-2 8x22B

WizardLM-2 8x22B is a model from Microsoft. It has 2 scored results in 2 categories. It has no index.

  • Input: text
  • Released 2024-04
UnrankedEnough results for an index.
IndexAll categories, out of 100.UnrankedMedian 51.0
CoverageIndex weight that has results.25%
SpeedOutput tokens per second.19/sMedian 67/s
First tokenSeconds to the first output token.1.5 sMedian 1.3 s
Input / 1MUS dollars per 1M input tokens.$0.62Median $0.60
Output / 1MUS dollars per 1M output tokens.$0.62Median $2.55
ContextMaximum tokens in one request.66KMedian 262K
EloLMArena rating and rank.—Median 1422

Details

From OpenRouter
API IDThe model ID on OpenRouter.
microsoft/wizardlm-2-8x22b
Max outputMaximum output tokens per request.
8K
Knowledge cutoffLast date of training data.
30 Apr 2024
ToolsTool calls on OpenRouter.
No
JSON outputOutput follows a given JSON schema.
No
Cache read / 1MUS dollars per 1M cached tokens.
—
WeightsLink to the published weights.
—
RetiresDate OpenRouter removes the model.
—

Capabilities

Index per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None counted——
CodingCode writing and repair.None counted——
ReasoningLogic problems and puzzles.None counted——
MultimodalTasks with images and text.None counted——
KnowledgeFacts and expert knowledge.1 counted17.0—
MultilingualTasks in many languages.None counted——
InstructionTasks with strict prompt rules.None counted——
MathMath problems.1 counted11.5—

Results

2 counted
BenchmarkThe benchmark name.ResultThe score from the source.PlacePlace among results on this benchmark.
MATH level 5Math25.7% ±0.964 / 88
GPQA diamond · Epoch AIKnowledge43.4% ±2.3169 / 217

Sources

BenchLMCC BY-NC 4.0OpenRouterTerms restrict reuseEpoch AICC BY

History

5 releases
Output / 1M$0.62 → $0.62
23 Oct 202612 Nov 2026

Questions

How much does WizardLM-2 8x22B cost?
$0.62 per 1M input tokens, $0.62 per 1M output tokens.
How fast is WizardLM-2 8x22B?
19 output tokens per second, 1.5 s to the first token.
What is the context window of WizardLM-2 8x22B?
66K tokens.
When was WizardLM-2 8x22B released?
April 2024.

More from Microsoft

All models
Phi-3.5-miniUnrankedPhi-422.4Phi-4 Multimodal InstructUnrankedPhi-4-reasoning27.1Phi-4-reasoning-plusUnranked