Inference
Epoch AI

Chess Puzzles

Evaluated by Epoch AI on their own harness.

ModelsModels with a result.122
Top resultBest result on this test.72.0%GPT-6 Astra
Top-3 spreadPoints from first to third.11.0 pts
YearYear of release.N/A

Result and price

020406080100$0.1$0.3$1$3$10$30$100$300RESULTOUTPUT PRICE PER 1M TOKENS · LOG SCALE

Results

122 results
#ModelResultThe score from the source.
01GPT-6 Astramax effort72.0% ±4.5
02GPT-5.5 Proxhigh effort64.0% ±4.8
03Gemini 3.8 Flashhigh effort61.0% ±4.9
04GPT-5.4 Proxhigh effort58.6% ±5.0
05GPT-5.6 Solmax effort55.0% ±5.0
06GPT-5.6 Terramax effort54.0% ±5.0
06GPT-5.5xhigh effort54.0% ±5.0
08Gemini 3.5 Flashhigh effort50.0% ±5.0
09Gemini 3.1 Prohigh effort49.0% ±5.0
09GPT-5.2xhigh effort49.0% ±5.0
11Claude Fable 5.1max effort47.0% ±5.0
11Gemini 3.7 Flashhigh effort47.0% ±5.0
13GPT-5.4xhigh effort44.0% ±5.0
14Claude Opus 5max effort42.0% ±5.0
15Claude Fable 5high effort41.0% ±4.9
16GPT-5.6 Lunamax effort40.0% ±4.9
16Gemini 3.6 Flashhigh effort40.0% ±4.9
16Gemini 3 Flashhigh effort40.0% ±4.9
16Qwen3.8 Max (0902)xhigh effort40.0% ±4.9
20Muse Spark 1.3max effort38.0% ±4.9
21GPT-5high effort37.0% ±4.9
22Grok 4.5high effort36.0% ±4.8
23Claude Opus 4.8max effort34.0% ±4.8
23o3high effort34.0% ±4.8
25GPT-5.1high effort32.0% ±4.7
26Grok 4.6xhigh effort31.0% ±4.6
26Gemini 3 Pro31.0% ±4.6
28GPT-5.4 nanohigh effort30.0% ±4.6
28GPT-5 minihigh effort30.0% ±4.6
30Qwen3.8 Maxxhigh effort29.0% ±4.6
31Grok 428.0% ±4.5
32GPT-5 nanohigh effort27.0% ±4.5
33o4-mini (high)high effort26.0% ±4.4
34Grok 4.3 Betahigh effort25.0% ±4.4
35GPT-5.4 minixhigh effort24.0% ±4.3
35Grok 4.2024.0% ±4.3
37Gemini 3.5 Flash-Litehigh effort22.0% ±4.2
37Qwen 3.5 Plus (hosted 397B-A17B)22.0% ±4.2
39GLM-5.3max effort21.0% ±4.1
39GLM-5.2max effort21.0% ±4.1
39Kimi K2.7 Code21.0% ±4.1
39Inklingxhigh effort21.0% ±4.1
39Qwen 3.5 Flash (hosted 35B-A3B)21.0% ±4.1
44DeepSeek V4 Pro 0423max effort20.0% ±4.0
44Qwen 3.6 Max (preview)20.0% ±4.0
44Kimi K2 Thinking20.0% ±4.0
44Gemini 2.5 Pro (Jun 2025)20.0% ±4.0
44GPT-OSS 120Bhigh effort20.0% ±3.1
44Gemini 3.1 Flash-Litehigh effort20.0% ±4.0
44Qwen3.6 Flash20.0% ±4.0
51Qwen3.7 Max19.0% ±3.9
51GLM-5.119.0% ±3.9
53Inkling-Smallxhigh effort18.0% ±3.9
54Qwen3.6 Plus17.0% ±3.8
54o3-minihigh effort17.0% ±3.8
56Claude Sonnet 5max effort16.0% ±3.7
57o1high effort15.0% ±3.6
58GLM-5.3-Flashmax effort14.0% ±3.5
58Claude Opus 4.6max effort14.0% ±3.5
60GPT-4o13.0% ±3.4
60Qwen3.5 397B A17Bnone effort13.0% ±3.4
62Kimi K2.512.0% ±3.3
62GPT-5.5 Instant12.0% ±3.3
62Qwen3-235B-A22B (Jul 2025)12.0% ±3.3
62Qwen3.5 9Bnone effort12.0% ±3.3
66GLM-510.0% ±3.0
66Qwen3.5-35B-A3Bnone effort10.0% ±3.0
68Qwen3.7 Plusnone effort9.0% ±2.9
68Qwen3.6-27Bnone effort9.0% ±2.9
68Qwen3.7 Flashnone effort9.0% ±2.9
71Claude Opus 4.58.0% ±2.0
71Claude Sonnet 4.58.0% ±2.0
71Claude Haiku 4.58.0% ±2.7
74DeepSeek V3.27.5% ±1.0
75Claude Opus 4.7max effort7.0% ±2.6
75Claude Opus 4.17.0% ±2.6
75GPT-4.1 mini7.0% ±2.6
78GLM-4.76.0% ±1.6
78Gemma 4 26B A4Bminimal effort6.0% ±2.4
78GPT-4.16.0% ±2.4
78GPT-4 Turbo (Apr 2024)6.0% ±2.4
82Gemma 4 31Bminimal effort5.0% ±2.2
82Claude 3 Opus5.0% ±2.2
82Qwen3-30B-A3B (Jul 2025)5.0% ±2.7
82QwQ 32B5.0% ±2.2
86MiniMax M3none effort4.0% ±2.0
86Qwen3.6-35B-A3Bnone effort4.0% ±2.0
86Qwen3 Max4.0% ±2.0
86GPT-4 (Jun 2023)4.0% ±2.0
90Claude Sonnet 4.6max effort3.0% ±1.7
90Magistral Small 1.23.0% ±1.7
92Phi-41.0% ±1.0
92DeepSeek R1 Distill Qwen 14B1.0% ±1.0
92DeepSeek R1 Distill Qwen 32B1.0% ±1.0
92Mistral Small 3.11.0% ±1.0
92Mistral Small 3.21.0% ±1.0
92Qwen3 30B A3Bnone effort1.0% ±1.0
92Qwen3 32Bnone effort1.0% ±1.0
92Qwen3 4Bnone effort1.0% ±1.0
100GPT-OSS 20Bhigh effort0.0%
100Gemma 3 27B0.0%
100GPT-4o mini0.0%
100DeepSeek LLM 67B0.0%
100DeepSeek R1 Distill Qwen 1.5B0.0%
100Gemma 3 12B0.0%
100Gemma 3 1B0.0%
100Gemma 3 4B0.0%
100GPT-3.5 Turbo0.0%
—Llama 2 13B0.0%
100Llama 2 7B0.0%
100Llama 3-8B0.0%
100Llama 3.1-8B0.0%
100Llama 3.2 1B0.0%
100Mistral 7B0.0%
100Mistral Small 30.0%
—phi-3-mini 3.8B0.0%
100Qwen2.5 32B0.0%
100Qwen2.5 7B0.0%
100Qwen3 1.7Bnone effort0.0%
100Qwen3 14Bnone effort0.0%
100Qwen3 8Bnone effort0.0%
100Qwen3.5 2Bnone effort0.0%