AI Paper Atlas

Research map / Video / Video generation

She Performs Your Voice: A Unified Speech and Dance Motion Model

Lurui Wang, yongkang cheng, Can Xu

NeurIPS 2026 · Video › Video generation · approach: Video-to-audio synthesis

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a unified audio-driven model that generates both speech-synchronized gestures and music-driven dance motion from a shared audio representation.

Problem

Existing audio-driven character systems treat audio as a task-specific condition, optimizing separately for co-speech gestures and music-driven dance, which fragments the shared perceptual link between sound and motion.

Approach

Treats audio as the shared perceptual driver of performance motion, unifying speech-driven gesture and music-driven dance generation in one model rather than separate task-specific systems.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy