Research map / Video / Video generation
VABench: A Comprehensive Benchmark for Audio-Video Generation
Daili Hua, Xizhi Wang, Bohan Zeng, Xinyi Huang, Hao Liang, Junbo Niu, Xinlong Chen, Quanqing Xu, Wentao Zhang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| end-to-end AV models vs decoupled V+A pipelines (T2AV) | Veo3/Sora2/Wan2.5 · VABench T2AV | Audio QA: 0.7999 (Veo3) vs 0.7300 (Kling+MMAudio, best V+A) | Improved |
| combine strongest video model with MMAudio instead of ThinkSound | Kling · VABench T2AV | Audio QA: 0.6932 -> 0.7300 | Improved |
| use image conditioning (I2AV) instead of text only | AV models · VABench | QA gap between models | Improved |
| use ThinkSound instead of MMAudio | V+A pipelines · VABench T2AV | Lip-Sync | Mixed |
| stereo generation from text prompts | Sora2/Veo3/Wan2.5 · VABench stereo | human check | No clear effect |
| compare VABench scores with human win rates | VABench · user study | Pearson correlation | Improved |
Closest papers by meaning
- VBench: Comprehensive Benchmark Suite for Video Generative Models (CVPR 2024 · similarity 0.92)
- Tell What You Hear From What You See - Video to Audio Generation Through Text (NeurIPS 2024 · similarity 0.89)
- Audio-Sync Video Generation with Multi-Stream Temporal Control (NeurIPS 2025 · similarity 0.89)
- Video-Bench: Human-Aligned Video Generation Benchmark (CVPR 2025 · similarity 0.88)
- AVGen-Bench: A Task-Driven Benchmark for Multi-Granular Evaluation of Text-to-Audio-Video Generation (ICML 2026 · similarity 0.88)
- VinTAGe: Joint Video and Text Conditioning for Holistic Audio Generation (CVPR 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
