AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

Cinematic Audio Source Separation Using Visual Cues

Kang Zhang, Suyeon Lee, Arda Senocak, Joon Son Chung

CVPR 2026 · Vision-language and multimodal › Cross-modal learning · approach: Audio-visual source localization · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add facial video stream to audio-only model (ablation)AV-CASS · AVDnRFAD: 1.63 -> 0.91Improved
add scene video stream to audio-only model (ablation)AV-CASS · AVDnRFAD: 1.63 -> 0.87Improved
add both facial and scene streams to audio-only model (ablation)AV-CASS · AVDnRFAD: 1.63 -> 0.84Improved
add both visual streams (ablation)AV-CASS · AVDnRKL: 1.15 -> 0.93Improved
add both visual streams (ablation)AV-CASS · AVDnRPESQ: 2.08 -> 2.26Improved
add both visual streams (ablation)AV-CASS · AVDnRSI-SDRi (dB): 12.23 -> 12.32No clear effect
add both visual streams (ablation)AV-CASS · AVDnRWPR (%): 2.01 -> 1.84Improved
add facial stream (ablation)AV-CASS · AVDnR DX stemWPR (%): 0.0265 -> 0.0164Improved
add scene stream (ablation)AV-CASS · AVDnR FX stemWPR (%): 4.6507 -> 4.0939Improved
add scene stream only (ablation)AV-CASS · AVDnR DX stemWPR (%): 0.0265 -> 0.0289Hurt
increase sampling steps to 32 (ablation)AV-CASS · AVDnRFADImproved
use dual-stream multi-source visual conditioning instead of single-target DAVIS-FlowAV-CASS · AVDnRFAD: 5.94 -> 0.84Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy