AI Paper Atlas

Research map / Video / Video generation

Seeing the Unseen: Unified Visible–Invisible Motion for Physically Consistent Video Generation

Mingyang Bao, Fangda Ye, Xihao Chen, Bobo Li, Xiangtai Li, Shengqiong Wu

NeurIPS 2026 · Video › Video generation · approach: Trajectory-guided motion control · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a unified visible-invisible motion framework to inject physical priors into video generation for more physically consistent dynamics (abstract only; details unavailable).

Problem

Video generation models often produce physically inconsistent dynamics because they lack explicit modeling of underlying physical processes; existing simulator-based or coarse semantic guidance approaches have strong assumptions or fail to inject physical priors effectively.

Approach

Unifies visible and invisible motion as a shared representation to inject physical priors into video generation, in contrast to simulator-dependent methods or coarse semantic guidance. Specific mechanism not stated in the available abstract.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add PGDS-simulated visible+invisible motion field to the video backboneWan2.2-TI2V-5B · DominoSA: 2.650 -> 3.976Improved
add PGDS-simulated motion field to the video backboneWan2.2-TI2V-5B · Free FallPC: 3.083 -> 4.328Improved
add future-emergent trajectories to visible-only guidance (ablation)Ours · DominoSA: 2.693 -> 3.976Improved
add future-emergent trajectories to visible-only guidance (ablation)Ours · VideoPhy2 subsetSA: 3.47 -> 4.01Improved
add future-emergent trajectories to visible-only guidance (ablation)Ours · TranslationSA: 3.837 -> 4.013Improved
use full dual-stream guidance instead of Wan-Move sparse tracksOurs · TranslationSA: 4.167 -> 4.013Hurt
use full dual-stream tracking instead of optical flow (Go with Flow)Ours · DominoSA: 2.583 -> 3.976Improved
drop about 25% of object tracks (ablation)Ours · Robustness avg of 7 scenariosSA: 4.095 -> 3.890Hurt
remove 1-2 segmented objects (ablation)Ours · Robustness avg of 7 scenariosSA: 4.095 -> 3.733Hurt
apply both perturbations (ablation)Ours · Robustness avg of 7 scenariosSA: 4.095 -> 3.598Hurt
add dual-stream conditioning (48 to 144 latent channels)Wan2.2-TI2V-5B · runtimetotal generation time: 144.20 s -> 150.28 sHurt
use LLM-based refinement instead of trajectory guidance (PhysT2V)PhysT2V · Free FallSA vs PC: SA 2.050, PC 4.283Mixed

Limitations

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy