AI Paper Atlas

Research map / Benchmarks / Video-Holmes

Video-Holmes leaderboard

14 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR report results on Video-Holmes. Best accuracy: 60.5 (VideoChat-M1 (37B), CVPR 2026).

Numbers are as each paper reports them, read by AI from its results tables and not checked by hand. Papers can differ in setting (training data, model size, extra data); the topic column shows what each paper is about. Open the paper before you compare or quote a number.

Video-Holmes · accuracy

14 papers, each with its best reported number for its own method; higher is better.

#accuracy ↑MethodPaperTopic
160.5VideoChat-M1 (37B)
4-agent group
VideoChat-M1: Collaborative Policy Planning for Video Understanding via Multi-Agent Reinforcement Learning
CVPR 2026 · Table 1
Cooperative multi-agent RL
252.3Video-R1 + FFR
Video-R1-SFT 7B
Find, Fix, Reason: Context Repair for Video Reasoning
ICML 2026 · Table 2
Reasoning and chain of thought
349.9Video-FLAIR
Qwen3-VL-8B
Video-FLAIR: Not Whether to Reason, But How
NeurIPS 2026 · Table 2
Video-language understanding
448.7OneThinker-8B
Qwen3-VL-8B-Instruct
OneThinker: All-in-one Reasoning Model for Image and Video
CVPR 2026 · Table 2
Multimodal LLMs
547.8SpecTemp (58.1 frames avg)
Qwen2.5-VL-7B target + 3B draft
Thinking with Drafts: Speculative Temporal Reasoning for Efficient Long Video Understanding
CVPR 2026 · Table 2
Video-language understanding
647.63OutRo
Qwen2.5-Omni-7B
On the Nature of Attention Sink that Shapes Decoding Strategy in Omni-LLMs
NeurIPS 2026 · Table 1
Language, safety and interpretability
746.5Video-o3 (SFT+RL)
Qwen2.5-VL-7B
Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning
ICML 2026 · Table 1
Video-language understanding
845.1+ AVATAR
Qwen2.5-Omni-7B
AVATAR: Reinforcement Learning to See, Hear, and Reason Over Video
CVPR 2026 · Table 2
Video-language understanding
944.6Conan
Qwen2.5-VL-7B-Instruct
Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidence
CVPR 2026 · Table 1
Video-language understanding
1043.8DeltaVid-Qwen3-VL-8B
Qwen3-VL-8B
DELTAVID: Enhancing Fine-Grained Spatiotemporal Perception with Cross-Video Differences
NeurIPS 2026 · Table 2
Video-language understanding
4 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

Not affiliated with any conference, journal or the benchmark's authors. Corrections: contact@latenticlabs.com.