Research map / Video / Video-language understanding
Scaling-up Perceptual Video Quality Assessment
Ziheng Jia, Zicheng Zhang, Xiaorong Zhu, Chunyi Li, Jinliang Han, Xiaohong Liu, Guangtao Zhai, Xiongkuo Min
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use complementary (sequential) training instead of direct training (ablation) | OmniVQA models · Q-bench-video-test overall | accuracy (%): 58.33% -> 58.50% | Improved |
| use complementary training instead of direct training (ablation) | Rater · LSVQ (test) | SRCC: 0.880 -> 0.902 | Improved |
| use complementary training instead of direct training (ablation) | Chatter · OmniVQA-FG-Bench machine annotated | accuracy (%): 68.00% -> 69.87% | Improved |
| use complementary training instead of random mixing (ablation) | Chatter · Q-bench-video-test overall | accuracy (%): 52.78% -> 58.50% | Improved |
| use complementary training instead of random mixing (ablation) | Rater · LSVQ (test) | SRCC: 0.898 -> 0.902 | No clear effect |
| use complementary training instead of random mixing (ablation) | Rater · KoNViD-1k, LIVE-VQC, OmniVQA-MOS-20K (test) | SRCC: KoNViD-1k 0.887 -> 0.895; LIVE-VQC 0.822 -> 0.826; MOS-20K 0.840 -> 0.837 | Mixed |
| scale instruction data from 100k to 400k (ablation) | Chatter · Q-bench-video-test, OmniVQA-FG-Bench | accuracy | Mixed |
| add human-annotated data to mixed training (ablation) | Chatter · Q-bench-video-test | accuracy | Improved |
| use chatter (understanding model) for quality rating instead of dedicated rater | Chatter · OmniVQA-MOS-20K (test) | SRCC: 0.837 (Rater) vs 0.810 | Hurt |
| train on OmniVQA-Chat-400K with in-context data | Chatter vs VQA2-Assistant · OmniVQA-FG-Bench machine annotated | accuracy (%): 55.33% -> 69.87% | Improved |
Closest papers by meaning
- PTM-VQA: Efficient Video Quality Assessment Leveraging Diverse PreTrained Models from the Wild (CVPR 2024 · similarity 0.90)
- AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM (CVPR 2025 · similarity 0.88)
- KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perception (CVPR 2025 · similarity 0.87)
- Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessment (AAAI 2024 · similarity 0.87)
- Modular Blind Video Quality Assessment (CVPR 2024 · similarity 0.87)
- Knowledge Guided Semi-supervised Learning for Quality Assessment of User Generated Videos (AAAI 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
