Inference
Vals AI

Code Migration

Can language models reimplement real-world programs in another language?

ModelsModels with a result.58
Top resultBest result on this test.67.7%GPT-6 Astra
Top-3 spreadPoints from first to third.12.7 pts
UpdatedDate the source changed the results.21 Sept 2026

Result and cost

020406080100$0.03$0.1$0.3$1$3$10$30$100$300RESULTUS DOLLARS PER TASK · LOG SCALE

Results

58 results
#ModelResultThe score from the source.CostUS dollars to run one task.TimeTime to run one task.
01GPT-6 Astra67.7%$44.3659 min
02Claude Opus 557.5%$60.512.9 h
03Claude Fable 555.1%$112.11.8 h
04Claude Fable 5.154.6%$70.974.3 h
05GPT-5.6 Sol52.9%$24.5459 min
06GPT-5.6 Terra47.8%$8.1349 min
07Hy4 preview47.4%$3.412.2 h
08Muse Spark 1.3 Max47.4%$14.2184 min
09Claude Opus 4.847.3%$30.5175 min
10DeepSeek V4.1 Flash45.6%$0.9451.8 h
11GPT-5.545.2%$6.4432 min
12Grok 4.744.8%$36.5569 min
13Grok 4.644.6%$14.581.5 h
14GPT-5.6 Luna44.5%$1.8859 min
15Claude Sonnet 544.4%$52.972.0 h
16GLM-5.344.2%$24.913.8 h
17Claude Opus 4.743.9%$36.3972 min
18Claude Sonnet 4.639.9%$38.511.7 h
19DeepSeek V4 Flash 042338.6%$3.612.1 h
20GLM-5.237.9%$12.641.9 h
21Grok 4.536.6%$3.3723 min
22Gemini 3.8 Flash36.5%$18.492.6 h
23GPT-5.435.0%$7.7636 min
24Gemini 3.7 Flash34.8%$21.462.6 h
25DeepSeek V4 Pro 042333.9%$18.583.5 h
26Muse Spark 1.131.1%$4.5639 min
27Gemini 3.6 Flash30.9%$8.931.5 h
28Muse Spark 1.230.0%$3.7831 min
29Muse Spark 1.327.6%$4.6268 min
30Gemini 3.5 Flash26.7%$5.7319 min
31GLM-5.125.8%$5.758 min
32Kimi K2.7 Code25.4%$5.041.7 h
33Qwen3.8 Max24.0%$10.544.5 h
34MiMo-V2.5-Pro21.6%$0.23849 min
35GLM-5.3-Flash20.5%$3.133.4 h
36MiniMax M319.9%$7.0774 min
37Gemini 3.1 Pro Preview17.3%$1.6112 min
38GPT-5.4 nano14.5%$0.41627 min
39MiMo-V2.514.2%$0.10338 min
40Qwen3.8-27B14.2%$21.684.8 h
41Inkling-Small13.7%$0.59721 min
42Qwen3.7 Max13.1%$1.9326 min
43GPT-5.4 mini12.9%$1.9529 min
44Qwen3.7 Plus12.9%$0.41936 min
45Inkling11.8%$3.0130 min
46Qwen3.6 Plus11.1%$4.7830 min
47MiniMax M2.78.7%$0.58821 min
48Claude Haiku 4.5 Thinking7.6%$0.98210 min
49Kimi K2.5 Thinking7.0%$0.92764 min
50Grok 4.36.8%$0.4173 min
51Gemini 3 Flash Preview6.4%$0.345 min
52Gemini 3.5 Flash-Lite6.1%$0.52522 min
53Mistral Medium 3.55.1%$18.623.6 h
54Gemini 3.1 Flash Lite Preview4.6%$0.0532 min
55Mercury 2.54.5%$0.62717 min
56Nemotron Lightning 3p5 30B A3B3.0%$0.26743 min
57Grok 4.20 (Reasoning)0.3%$0.2896 min
58Ling 3.0 Flash0.0%$0.065.0 h