Inference
SWE-bench team

SWE-bench Multilingual · swebench.com

Resolved-issue rate on real GitHub issues, as published by the SWE-bench team.

ModelsModels with a result.12
Top resultBest result on this test.N/A
Top-3 spreadPoints from first to third.N/A
UpdatedDate the source changed the results.20 Feb 2026

Result and cost

020406080100$0.03$0.1$0.3$1$3RESULTUS DOLLARS PER TASK · LOG SCALE

Results

12 results
#ModelResultThe score from the source.CostUS dollars to run one task.
—Gemini 3 Flashmini-SWE-agent72.7%$0.352
—Claude 4.6 Opusmini-SWE-agent72.0%$0.663
—Claude 4.5 Opusmini-SWE-agent70.7%$0.834
—GLM-5mini-SWE-agent69.7%$0.642
—Gemini 3 Promini-SWE-agent68.7%$1.02
—MiniMax M2.5mini-SWE-agent68.3%$0.101
—Kimi K2.5mini-SWE-agent67.3%$0.693
—Claude 4.5 Sonnetmini-SWE-agent67.0%$0.67
—GPT-5.2high effort · mini-SWE-agent66.7%$0.536
—Claude 4.5 Haikumini-SWE-agent64.7%$0.379
—DeepSeek V3.2mini-SWE-agent59.0%$0.384
—GPT-5 minimini-SWE-agent39.7%$0.052