Research map / Video / Video-language understanding
LVBench: An Extreme Long Video Understanding Benchmark
Weihan Wang, Zehai He, Wenyi Hong, Yean Cheng, Xiaohan Zhang, Ji Qi, Ming Ding, Xiaotao Gu, Shiyu Huang, Bin Xu, Yuxiao Dong, Jie Tang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| increase input frames from 50 to dense 1 FPS (ablation) | Seed1.5-VL, Gemini-2.5-Pro, Qwen2.5-VL-72B · LVBench | accuracy | Improved |
| increase input frames from 1 to 8 (ablation) | Seed1.5-VL, Gemini-2.5-Pro, Qwen2.5-VL-72B · LVBench | accuracy | Improved |
| give 0 frames (text-only input) (ablation) | Seed1.5-VL, Gemini-2.5-Pro, Qwen2.5-VL-72B · LVBench | accuracy | Hurt |
| use native long-video support instead of sampled frames from short-video models | video MLLMs · LVBench | overall accuracy: 22.5 (MovieChat) vs 45.3 (VideoLLaMA3-7B, non-native) | Mixed |
| filter questions answerable by text-only LLMs (GLM-4 and GPT-4 both correct) | LVBench construction · LVBench | dataset size | Improved |
Closest papers by meaning
- MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding (NeurIPS 2024 · similarity 0.91)
- LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding (NeurIPS 2024 · similarity 0.91)
- Unleashing Hour-Scale Video Training for Long Video-Language Understanding (NeurIPS 2025 · similarity 0.90)
- MVBench: A Comprehensive Multi-modal Video Understanding Benchmark (CVPR 2024 · similarity 0.90)
- Online Video Understanding: OVBench and VideoChat-Online (CVPR 2025 · similarity 0.90)
- SVBench: A Benchmark with Temporal Multi-Turn Dialogues for Streaming Video Understanding (ICLR 2025 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
