Inference

MMMU-Pro with Python

Tool-augmented MMMU-Pro variant that allows Python assistance during multimodal reasoning.

  • Not in index
  • Multimodal
ModelsModels with a result.9
Top resultBest result on this test.N/A
Top-3 spreadPoints from first to third.N/A
YearYear of release.N/A

Result and price

020406080100$1$3$10$30$100RESULTOUTPUT PRICE PER 1M TOKENS · LOG SCALE

Results

9 results
#ModelResultThe score from the source.
—GPT-5.6 Sol84.6%
—Kimi K383.4%
—GPT-5.583.2%
—GPT-5.482.1%
—GPT-5.6 Terra82.0%
—Kimi K2.680.1%
—GPT-5.6 Luna79.5%
—GPT-5.4 mini78.0%
—GPT-5.4 nano69.5%