Skip to content

Claude Fable 5.1 on Video-MME v2

About Video-MME v2How this is measured

66.2%Rank #3 of 9 on Video-MME v2
2,118 of 3,200 questions answered correctly.
Coverage
99.72% (3191/3200)
Cost per task
$1.399
Median latency
14.2s
Tokens per task
137,657 in · 448 out

Run setting: 1 fps.

Tokens and latency

Tokens per call

Token typeMeanMedian90th pct.
Input137,657147,028147,400
of which cached117,657146,886146,886
Output4481251,120

Over 7,086 calls that returned an answer, including questions asked again after a failed attempt.

Latency

Median
14.2s
Mean
20.7s
90th percentile
40.8s
99th percentile
84.6s

Per call, end to end including file upload and processing.