Skip to content

Robust evaluation of real-world vision tasks.

Vision Index measures frontier vision models against benchmarks and evaluations that match the complexity of real-world video tasks.

A frame of the evaluation video being scored

Leaders on the index, cost per task and latency

Latency

Median latency per task. Lower is better.

The Visual Intelligence Index

The Visual Intelligence Index combines different benchmarks to evaluate vision model capabilities in understanding video.

Read the Methodology here

Visual Intelligence Index

Visual Intelligence Index v0 is a weighted average of 6 capability indexes. Updated November 7, 2026.

10 of 10 models
Filter by model access

Display

Cost & Latency Frontier

The index score against cost per task, latency per task and tokens per task.

10 of 10 models
Filter by model access

Display

  • Google
  • OpenAI
  • Anthropic
  • Alibaba
  • Moonshot
  • Most attractive quadrant
  • Pareto frontier
  • Visual Intelligence Index axis starts at 70, not 0

Not shown (self-hosted): Qwen3.8-27B, Qwen3.5-35B-A3B, Nemotron 3 Nano Omni 30B-A3B, Molmo 2 8B

Capability Index Scores

Each index is a cross-benchmark weighted score of benchmark questions classified by capability.

10 of 10 models
Filter by model access

Display

ModelVideo-MME v2LVBenchPerception TestNExT-QAQ-Bench VideoEgoSchemaUCF101-ADAverage
Gemini 4 Argon77.0% (top score) (missing coverage)86.3% (missing coverage)89.7%90.0%66.9%86.4% (top score)81.8% (top score)82.6%
GPT-6 Astra73.4%81.6%92.5% (top score)90.7% (top score)68.3%83.4%61.4%78.8%
Gemini 3.8 Flash71.3%86.4% (top score)85.5%88.0%69.3%80.8%63.5%77.8%
Claude Fable 5.166.2% (missing coverage)75.0%77.3%86.8%71.0% (top score)80.4% (missing coverage)60.6%73.9%
Qwen3.8-Max60.2% (missing coverage)58.9% (missing coverage)83.9%87.6% (missing coverage)69.0% (missing coverage)85.2% (missing coverage)56.5% (missing coverage)71.6%
Kimi K355.2%66.8%82.4%86.3%67.5%78.6%39.4%68.0%
Qwen3.8-27B50.5%64.6%72.3%82.2%67.9%79.1%45.5%66.0%
Qwen3.5-35B-A3B42.5%64.4%66.7%83.4%66.9%77.2%41.3%63.2%
Nemotron 3 Nano Omni 30B-A3B35.0%54.2%70.3%81.2%64.9%65.8%31.0%57.5%
Molmo 2 8B27.5%48.6%67.4%89.2%62.9%58.2%19.5%53.3%

Benchmark scores report multiple choice accuracy. Select a score to see every question behind it. * score has missing coverage

Arena Ranking

Ratings from blind, head-to-head votes on video tasks people bring themselves.

Coming soon

The arena ranking is collecting votes. It will be published here once every model has enough battles for a stable rating.

Try the arena

Vision Benchmarks

Show all 7 benchmarks