AI Paper Atlas

Research map / Video / Video generation

FoleyDirector: Fine-Grained Temporal Steering for Video-to-Audio Generation via Structured Scripts

You Li, Dewei Zhou, Fan Ma, Fu Li, Dongliang He, Yi Yang

CVPR 2026 · Video › Video generation · approach: Video-to-audio synthesis · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add Structured Temporal Scripts via Temporal Script Attention (ablation)MMAudio · DirectorBench (overall)F1: 0.1311 -> 0.4252Improved
add interleaved RoPE to STS fusion (ablation)FoleyDirector · DirectorBench (overall)F1: 0.4252 -> 0.4389Improved
add Bi-Frame Sound Synthesis (ablation)FoleyDirector · DirectorBench (overall)F1: 0.4389 -> 0.4819Improved
add Bi-Frame on the complex reannotated subset (ablation)FoleyDirector · DirectorBench (reannotated subset)F1: 0.4178 -> 0.4613Improved
shorten STS segments from 1s to 0.5s at inference (ablation)FoleyDirector · DirectorBench (overall)F1: 0.4819 -> 0.5197Improved
lengthen STS segments from 1s to 2s at inference (ablation)FoleyDirector · DirectorBench (overall)F1: 0.4819 -> 0.4646Hurt
add STS control to MMAudioMMAudio · VGGSound-DirectorFD_VGG: 1.45 -> 1.17Improved
add STS control to MMAudioMMAudio · VGGSound-DirectorFD_PANN / FD_PaSST: 8.23 -> 8.60; 92.80 -> 94.27Mixed
disable SG-TFM at inference (Ours w/o STS) (ablation)FoleyDirector · VGGSound-DirectorFD_PANN / DeSync: FD_PANN 8.58 vs MMAudio 8.23; DeSync 0.438 vs 0.439No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy