Inference
EN
Vals AI

Terminal-Bench-Science

Research workflow tasks contributed by practicing scientists across five domains

ModelsModels with a result.44
Top resultBest result on this benchmark.62.9%GPT-6 Astra
Top-3 spreadPoints from first to third.10.0 pts
UpdatedDate the source changed the results.9 Nov 2026

Result and cost

43 of 44 results

Results

44 results
#ModelResultThe score from the source.CostUS dollars to run one task.TimeTime to run one task.
01GPT-6 AstraMini-SWE-agent62.9% ±5.8$20.801.8 h
02Claude Fable 5.2Mini-SWE-agent55.7% ±6.0$23.141.6 h
03GPT-6.1 SolMini-SWE-agent52.9% ±6.0$3.4483 min
04Claude Opus 5.5Mini-SWE-agent47.1% ±6.0$19.122.5 h
04Claude Sonnet 5.5Mini-SWE-agent47.1% ±6.0$19.572.8 h
06Gemini 4 ArgonMini-SWE-agent44.3% ±6.0$44.901.8 h
07Claude Fable 5.1Mini-SWE-agent40.0% ±5.9$38.012.6 h
08Muse Wonder FullMini-SWE-agent37.1% ±5.8$22.813.6 h
09GPT-6 SolMini-SWE-agent30.0% ±5.5$5.8282 min
10Claude Opus 5Mini-SWE-agent27.1% ±5.4$32.542.2 h
11Muse WonderMini-SWE-agent22.9% ±5.1$19.611.6 h
12GPT-5.6 SolMini-SWE-agent20.0% ±4.8$7.321.7 h
13Claude Fable 5Mini-SWE-agent15.7% ±4.4$51.992.0 h
14Qwen3.8 MaxMini-SWE-agent12.9% ±4.0$16.683.4 h
15Grok 4.6Mini-SWE-agent11.4% ±3.8$4.8278 min
16Grok 4.7Mini-SWE-agent10.0% ±3.6$17.041.5 h
16GPT-5.6 TerraMini-SWE-agent10.0% ±3.6$5.192.1 h
16Claude Haiku 5.5Mini-SWE-agent10.0% ±3.6$4.521.6 h
16Muse Spark 1.3 MaxMini-SWE-agent10.0% ±3.6$6.0984 min
20Gemini 3.8 FlashMini-SWE-agent8.6% ±3.4$5.6455 min
21Gemini 3.7 FlashMini-SWE-agent7.1% ±3.1$7.1980 min
22GLM-5.3Mini-SWE-agent5.7% ±2.8$15.632.7 h
22Claude Sonnet 5Mini-SWE-agent5.7% ±2.8$30.303.1 h
22Gemini 3.5 FlashMini-SWE-agent5.7% ±2.8$3.8061 min
22Ember-1Mini-SWE-agent5.7% ±2.8$30.763.4 h
26Muse Spark 1.3Mini-SWE-agent4.3% ±2.4$4.4168 min
26Claude Opus 4.8Mini-SWE-agent4.3% ±2.4$23.141.9 h
26GPT-6 LunaMini-SWE-agent4.3% ±2.4$0.24176 min
26DeepSeek V4 Pro 0813Mini-SWE-agent4.3% ±2.4$4.632.3 h
26MiMo-V2.6-FlashMini-SWE-agent4.3% ±2.4$0.2444.0 h
26Gemini 3.6 FlashMini-SWE-agent4.3% ±2.4$4.391.9 h
26DeepSeek V4 Flash 0731Mini-SWE-agent4.3% ±2.4$1.101.6 h
33MiMo-V2.6-ProMini-SWE-agent2.9% ±2.0$0.6213.2 h
33Step 5 PreviewMini-SWE-agent2.9% ±2.0$4.252.5 h
33Inkling 2 SmallMini-SWE-agent2.9% ±2.0$5.552.5 h
33GLM-5.3-FlashMini-SWE-agent2.9% ±2.0$0.5243.5 h
37Kimi K3Mini-SWE-agent1.4% ±1.4$21.304.8 h
37Hy4 previewTerminus 21.4% ±1.4$2.143.8 h
37Gemini 3.1 Pro PreviewMini-SWE-agent1.4% ±1.4$5.9144 min
37Beam 1.0Mini-SWE-agent1.4% ±1.4—78 min
41DeepSeek V4.1 Flash 1017Mini-SWE-agent0.0%$0.4733.0 h
41GPT-5.6 LunaMini-SWE-agent0.0%$0.5812.1 h
41Qwen3.8-27BMini-SWE-agent0.0%$11.144.0 h
41Mercury 2.5Mini-SWE-agent0.0%$0.17828 min