Seed 2.1 Pro

Seed 2.1 Pro is a reasoning model from ByteDance in the Seed 2.1 family. 6 benchmarks count toward its score, in 4 categories.

partialShows if the model has enough results for an index.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.65%
SpeedOutput tokens per second.
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.256K
EloLMArena rating and rank.N/A

The index is a score out of 100. The ± range shows how much it can change.

CapabilitiesScore per category, out of 100.

Out of 100
AgenticMulti-step tasks with tools.
66.0
CodingCode writing and repair.
61.8
ReasoningLogic problems and puzzles.
N/A
MultimodalTasks with images and text.
63.2
KnowledgeFacts and expert knowledge.
56.1
MultilingualTasks in many languages.
N/A
InstructionTasks with strict rules in the prompt.
N/A
MathMath problems.
N/A

Results

6 counted
BenchmarkThe test name.CategoryThe capability that the test measures.ResultThe score from the publisher.IndexThis result as a score out of 100.RunThe settings of the run.DateDate of the result.Published byThe source of the result.
MathVisionMultimodal92.6%Qwen
Video-MMEMultimodal89.2%Video-MME benchmark team
CharXiv ReasoningMultimodal85.4%63.3CharXiv authors
Massive Multi-discipline Multimodal Understanding ProMultimodal81.6%60.1MMMU-Pro authors
BabyVisionMultimodal73.7%Meta AI
ERQAMultimodal72.0%66.2Qwen
Terminal-Bench 2.1 (provider run)Agentic71.0%66.0DeepSeek-AI
Terminal-Bench 2.1 (provider run)Agentic71.0%66.0DeepSeek-AI
SuperGPQA: Scaling LLM Evaluation Across 285 Graduate DisciplinesKnowledge70.8%56.1Xiaoxuan Du et al.
NL2RepoCoding47.0%61.8MiniMax
ZeroBenchMultimodal18.0%Meta AI

6 benchmarks count, from 7 of 11 results. A grey row does not count. Too few models took that benchmark.

Sources

BenchLM benchmark aggregationUsed with attribution; per-benchmark results credited to their original authors

More from ByteDance

Seed 1.6UnrankedSeed 1.6 FlashUnrankedSeed 2.1 TurboUnrankedSeed-2.0-LiteUnrankedSeed-2.0-MiniUnranked