AI Paper Atlas

Research map / Video / Video generation

Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generation

Shihao Cheng, Jiaxu Zhang, Quanyue Song, Shansong Liu, Guo Zhi, Xiao-Lei Zhang, Chi Zhang, Xuelong Li, Zhigang Tu

ECCV 2026 · Video › Video generation · approach: Video-to-audio synthesis · 10 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
remove semantic-guided harmonization (decoupled speech/SFX streams) (ablation)Unison · TI2AV test setPQ: 6.12 -> 6.34Improved
add Bi-ACA between speech and SFX streams (ablation)Unison · TI2AV test setPQ: 6.20 -> 6.34Improved
add semantic-conditioned gating (ablation)Unison · TI2AV test setPQ: 6.21 -> 6.34Improved
add cross-modal forcing strategy (ablation)Unison · TI2AV test setDS: 0.19 -> 0.08Improved
add cross-modal forcing (ablation)Unison · TI2AV test setVA: 3.91 -> 4.02Improved
audio-side modules (SGHS, Bi-ACA, SCG) on video quality (ablation)Unison · TI2AV test setVA: 3.99-4.01 -> 4.02No clear effect
progressive three-phase schedule instead of synchronous timesteps (ablation)Unison · TI2AV test setDS: 0.17 -> 0.08Improved
progressive schedule instead of independent timesteps without warmup (ablation)Unison · TI2AV test setLSE-C: 3.28 -> 3.30Improved
Unison vs LTX-2 on visual aestheticsUnison · TI2AV test setVA: 4.15 -> 4.02Hurt
Unison vs LTX-2 in user study lip-syncUnison · user studylip-sync mean rank: 1.74 -> 1.86Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy