MMLU-Redux

A harder refresh of MMLU intended to keep broad knowledge evaluation useful after the original benchmark became too easy for frontier models.

ModelsModels with a result.19
Top resultBest result on this benchmark.96.6%Claude Opus 4.5
Top-3 spreadPoints from first to third.1.7 pts
YearYear of release.—

Result and price

11 of 19 results

Results

19 results
#ModelResultThe score from the source.
11QwQ-32B90.0%
16Qwen3 32B85.7%