Inference
EN
Epoch AI

FrontierMath-2025-02-28-Private

Evaluated by Epoch AI on their own harness.

ModelsModels with a result.69
Top resultBest result on this benchmark.51.7%GPT-5.5
Top-3 spreadPoints from first to third.1.7 pts
YearYear of release.—

Result and price

53 of 69 results

Results

69 results
#ModelResultThe score from the source.
01GPT-5.5xhigh effort51.7% ±2.9
02GPT-5.5 Proxhigh effort51.0% ±2.9
03GPT-5.4 Proxhigh effort50.0% ±2.9
04GPT-5.4xhigh effort47.6% ±2.9
05Claude Opus 4.8max effort47.2% ±2.9
06Claude Opus 4.7xhigh effort43.8% ±2.9
07GPT-5.2xhigh effort40.7% ±2.9
07Claude Opus 4.6max effort40.7% ±2.9
09Muse Spark39.0% ±2.9
09Gemini 3.5 Flashhigh effort39.0% ±2.9
09Kimi K2.639.0% ±2.9
12Gemini 3 Pro37.6% ±2.8
13Gemini 3.1 Pro36.9% ±2.8
14Gemini 3 Flash35.6% ±2.8
15GLM-5.133.4% ±2.8
16GPT-5high effort32.4% ±2.8
16Claude Sonnet 4.632.4% ±2.8
18GPT-5.1high effort31.0% ±2.7
19Gemini 2.5 Deep Think29.0% ±2.7
20GPT-5.4 minihigh effort28.3% ±2.1
21Kimi K2.527.9% ±2.6
22GPT-5 minihigh effort27.2% ±2.6
23Qwen3.6 Plus26.2% ±2.6
24GPT-5.4 nanohigh effort25.9% ±2.6
25o4-minihigh effort24.8% ±2.5
26Qwen 3.6 Max (preview)23.1% ±2.5
27DeepSeek V3.222.1% ±4.1
28Kimi K2 Thinking21.4% ±2.4
29Qwen 3.5 Plus (hosted 397B-A17B)21.0% ±2.4
30Claude Opus 4.520.7% ±2.4
31Grok 419.7% ±2.3
32o3high effort18.7% ±2.3
33GLM-516.4% ±2.2
34Claude Sonnet 4.513.5% ±2.0
35o3-minihigh effort12.4% ±1.9
36Gemini 2.5 Pro (Jun 2025)12.2% ±2.0
37Qwen3.6 Flash10.3% ±1.8
38o1high effort9.3% ±1.7
39Qwen3-235B-A22B (Jul 2025)8.5% ±1.7
40GPT-5 nanohigh effort8.3% ±1.6
41Claude Opus 4.16.6% ±1.5
42Qwen 3.5 Flash (hosted 35B-A3B)6.2% ±1.4
43Grok 3 Minihigh effort5.9% ±1.4
44GPT-4.15.5% ±1.3
45Claude Haiku 4.55.0% ±1.4
46Gemini 2.5 Flash4.8% ±1.3
47GPT-4.1 mini4.5% ±1.2
48Claude Opus 44.3% ±1.2
49Claude Sonnet 44.1% ±1.2
50GLM-4.63.8% ±1.1
50Grok 3 [Beta]3.8% ±1.1
52Claude 3.7 Sonnet3.3% ±1.0
53GLM-4.72.4% ±0.9
54Claude 3.5 Sonnet (October 2024)2.1% ±0.8
55DeepSeek V31.7% ±0.8
55Gemini 2.0 Flash1.7% ±0.8
55Qwen Plus1.7% ±0.8
58o1-minihigh effort1.4% ±0.7
59Claude 3.5 Sonnet1.0% ±0.6
59GPT-4.1 nano1.0% ±0.6
59Qwen2.5-Max1.0% ±0.6
62Llama 4 Maverick0.7% ±0.5
62Grok 20.7% ±0.5
64Mistral Medium 30.3% ±0.3
64GPT-4o0.3% ±0.3
64Mistral Large 20.3% ±0.3
64Claude 3.5 Haiku0.3% ±0.3
68Llama 4 Scout0.0%
68Gemini 1.5 Flash0.0%