Inference
Vals AI

MysteryMechanism

Can agents rediscover sealed mathematical mechanisms through bounded experiments?

ModelsModels with a result.12
Top resultBest result on this test.53.2%GPT-6 Astra
Top-3 spreadPoints from first to third.15.8 pts
UpdatedDate the source changed the results.21 Sept 2026

Result and cost

020406080100$0.1$0.3$1$3$10RESULTUS DOLLARS PER TASK · LOG SCALE

Results

12 results
#ModelResultThe score from the source.CostUS dollars to run one task.TimeTime to run one task.
01GPT-6 Astra53.2%$1.778 min
02Claude Fable 5.147.7%$5.6318 min
03Claude Opus 537.4%$3.2817 min
04Gemini 3.8 Flash36.5%$1.735 min
05Muse Spark 1.3 Max36.0%$0.8528 min
06GPT-5.6 Sol33.3%$1.59 min
07Grok 4.630.6%$1.3128 min
08Grok 4.725.2%$3.6618 min
09Qwen3.8 Max23.9%$1.3138 min
10GLM-5.323.0%$1.5331 min
11DeepSeek V4.1 Flash21.2%$0.1648 min
12GPT-5.6 Luna14.4%$0.1888 min