Inference
Vals AI

Terminal-Bench 2.1

State-of-the-art set of difficult terminal-based tasks

ModelsModels with a result.63
Top resultBest result on this test.87.3%GPT-6 Astra
Top-3 spreadPoints from first to third.2.2 pts
UpdatedDate the source changed the results.21 Sept 2026

Result and cost

020406080100$0.01$0.03$0.1$0.3$1$3$10RESULTUS DOLLARS PER TASK · LOG SCALE

Results

63 results
#ModelResultThe score from the source.CostUS dollars to run one task.TimeTime to run one task.
01GPT-6 Astra87.3%$1.345 min
02GPT-5.6 Sol85.8%$1.026 min
03Claude Fable 5.185.0%$3.078 min
04Claude Opus 584.6%$0.88713 min
05Gemini 3.8 Flash81.3%$1.549 min
06Claude Fable 580.5%$1.438 min
07GPT-5.6 Luna79.0%$0.0546 min
07Muse Spark 1.3 Max79.0%$0.59712 min
09Grok 4.678.3%$0.45411 min
10GPT-5.6 Terra77.5%$0.4739 min
10Gemini 3.7 Flash77.5%$1.028 min
12GPT-5.576.4%$0.7427 min
13DeepSeek V4.1 Flash74.5%$0.09910 min
13Claude Sonnet 574.5%$0.79611 min
15Gemini 3.5 Flash74.2%$0.8686 min
16Gemini 3.6 Flash73.8%$1.179 min
17Grok 4.773.4%$1.0813 min
18Muse Spark 1.372.3%$0.66314 min
19Claude Opus 4.871.9%$2.4115 min
20GLM-5.371.5%$0.30713 min
21Gemini 3.1 Pro Preview70.8%$0.5837 min
22Muse Spark 1.269.7%$0.49915 min
22Claude Opus 4.8 Claude CodeClaude Code69.7%$0.9686 min
24Muse Spark 1.169.3%$0.41710 min
25Claude Opus 4.768.5%$1.9814 min
26Grok 4.567.8%$0.28410 min
26GLM-5.267.8%$0.42514 min
28Qwen3.8 Max67.4%$0.44815 min
29DeepSeek V4 Flash 042367.0%$0.02111 min
29Kimi K2.7 Code67.0%$0.25713 min
31GLM-5.3-Flash62.9%$0.02816 min
32Qwen3.7 Max61.0%$0.33216 min
33MiMo-V2.560.7%$0.02213 min
34Qwen3.8-27B58.4%$0.67815 min
34Composer 2.5Cursor CLI58.4%—0 s
36MiMo-V2.5-Pro57.3%$0.04414 min
36Claude Sonnet 4.657.3%$0.57212 min
36GPT-5.5 CodexCodex57.3%$0.6453 min
36GPT-5.5 FactoryFactory57.3%$0.7526 min
40GLM-5.156.9%$0.23216 min
41Hy4 preview55.1%$0.1418 min
41Inkling-Small55.1%$0.12810 min
43GPT-5.4 mini54.7%$0.28711 min
44Gemini 3 Flash Preview53.9%$0.1546 min
45MiniMax M353.6%$0.20617 min
46Qwen3.6 Plus53.2%$0.20213 min
47Qwen3.7 Plus52.8%$0.09611 min
48DeepSeek V4 Pro 042352.4%$0.214 min
49Gemini 3.5 Flash-Lite50.2%$0.3377 min
49Ling 3.0 Flash50.2%$0.06710 min
51MiniMax M2.748.7%$0.06614 min
52Inkling47.6%$0.63113 min
53Grok 4.20 (Reasoning)44.2%$0.4075 min
54Claude Haiku 4.5 Thinking43.8%$0.36411 min
55Grok 4.341.9%$0.9828 min
55Kimi K2.5 Thinking41.9%$0.08618 min
57GPT-5.4 nano41.6%$0.07213 min
58Mistral Medium 3.539.0%$1.1916 min
59Gemini 3.1 Flash Lite Preview34.1%$0.0855 min
59Mercury 2.534.1%$0.21111 min
59Laguna M.134.1%$0.30120 min
62Laguna XS.225.8%$0.25420 min
63Nemotron Lightning 3p5 30B A3B10.9%$0.01417 min