Inference

SimpleVQA

A visual question answering benchmark focused on straightforward image-grounded understanding.

  • In index
  • Multimodal
ModelsModels with a result.11
Top resultBest result on this test.81.7%Qwen3.7 Plus
Top-3 spreadPoints from first to third.6.7 pts
YearYear of release.N/A

Result and price

020406080100$0.3$1$3$10$30RESULTOUTPUT PRICE PER 1M TOKENS · LOG SCALE

Results

11 results
#ModelResultThe score from the source.
01Qwen3.7 Plus81.7%
02Step 3.7 Flash79.2%
03Qwen3.8 Max75.0%
04dots3-note Preview72.5%
05Gemini 3.1 Pro72.4%
06Muse Spark71.3%
07GPT-5.461.1%
08Qwen3.6-35B-A3B58.9%
09Grok 4.2057.4%
10Qwen3.6-27B56.1%
11LFM2.5-VL-3B35.4%