Inference

ERQA

A grounded visual reasoning benchmark focused on evidence-based question answering over real images.

  • In index
  • Multimodal
ModelsModels with a result.13
Top resultBest result on this test.77.8%Qwen3.8 Max
Top-3 spreadPoints from first to third.5.8 pts
YearYear of release.N/A

Result and price

020406080100$1$3$10$30RESULTOUTPUT PRICE PER 1M TOKENS · LOG SCALE

Results

13 results
#ModelResultThe score from the source.
01Qwen3.8 Max77.8%
02Qwen3.8-Flash-Next72.3%
03Seed 2.1 Pro72.0%
04Seed 2.1 Turbo71.3%
05Qwen3.8-Omni-Flash71.0%
06Qwen3.7 Plus69.8%
07Gemini 3.1 Pro69.4%
08Qwen3.8-27B65.5%
09GPT-5.465.4%
10Muse Spark64.7%
11Qwen3.6-27B62.5%
12Grok 4.2054.1%
13Claude Opus 4.651.6%