Skip to content

Qwen3.8-Max on Video-MME v2

About Video-MME v2How this is measured

60.2%Rank #4 of 9 on Video-MME v2
1,927 of 3,200 questions answered correctly.
Coverage
98.5% (3152/3200)
Cost per task
$0.370
Median latency
145.7s
Tokens per task
166,837 in · 6,060 out

Run setting: 1 fps native video, ~256k visual-token ceiling (168 videos thinned).

Tokens and latency

Tokens per call

Token typeMeanMedian90th pct.
Input166,837161,564255,407
of which cached127,655131,072252,928
of which frames or video166,614161,213255,265
Output6,0605,91211,492

Over 3,565 calls that returned an answer, including questions asked again after a failed attempt.

Latency

Median
145.7s
Mean
152.3s
90th percentile
262.2s
99th percentile
363.6s

Per call, end to end including file upload and processing.