Molmo 2 8B on Video-MME v2

27.5%Rank #9 of 9 on Video-MME v2

881 of 3,200 questions answered correctly.

Run setting: 1 fps, 338-frame cap (673 videos thinned).

Tokens and latency

Token type	Mean	Median	90th pct.
Input	29,699	30,473	30,633
of which cached	22,137	30,320	30,336
Output	2	2	2

Over 3,200 calls that returned an answer, including questions asked again after a failed attempt.

We only consider the first question against a video for self hosted models, ignoring prefix caching latency.