Massive Multitask Language Understanding

A comprehensive multiple-choice question answering test covering 57 tasks including elementary mathematics, US history, computer science, law, and more. Tests knowledge across diverse academic subjects from high school to professional level.

ModelsModels with a result.34
Top resultBest result on this benchmark.91.8%o1
Top-3 spreadPoints from first to third.1.0 pts
YearYear of release.2020

Result and price

17 of 34 results

Results

34 results
#ModelResultThe score from the source.
01o191.8%
02GPT-4.590.8%
05GPT-4.190.2%
06o4-mini90.0%
09Kimi K289.5%
10Grok 287.5%
13o3-mini86.9%
20o1-mini85.2%
22Phi-484.8%