Research map / Video / Video generation
Bridging Your Imagination with Audio-Video Generation via a Unified Director
Jiaxu Zhang, Tianshu Hu, Yuan Zhang, Zenan Li, Linjie Luo, Mingyuan Gao, Guosheng Lin, Xin Chen
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add In-Context ID Prompting (ablation) | UniMAGE · ViStoryBench-V3 | CIDS: 55.6 -> 59.2 | Improved |
| add In-Context ID Prompting (ablation) | UniMAGE · ViStoryBench-V3 | Alignment: 62.5 -> 80.8 | Improved |
| add In-Context ID Prompting (ablation) | UniMAGE · ViStoryBench-V3 | Inception: 12.06 -> 12.97 | Improved |
| add In-Context ID Prompting (ablation) | UniMAGE · ViStoryBench-V3 | CSD: 52.6 -> 59.0 | Improved |
| add Disentangled Expert Learning (ablation) | UniMAGE · ViStoryBench-V3 | Aesthetics: 3.91 -> 4.55 | Improved |
| add Disentangled Expert Learning (ablation) | UniMAGE · ViStoryBench-V3 | Inception: 9.85 -> 12.97 | Improved |
| add Disentangled Expert Learning (ablation) | UniMAGE · ViStoryBench-V3 | Alignment: 77.4 -> 80.8 | Improved |
| add Disentangled Expert Learning (ablation) | UniMAGE · ViStoryBench-V3 | CSD: 61.8 -> 59.0 | Hurt |
| add Pre-Context Script Splitting with disentangled text training (ablation) | UniMAGE · script extension and continuation (qualitative) | repetition and narrative coherence | Improved |
| use unified MoT director instead of separate script and image agents | UniMAGE · ViStoryBench-V3 | OCCM: 85.9 -> 88.07 | Improved |
Earlier methods this paper compares with
Named baselines from earlier accepted papers in this paper's results tables: better than 0 of 1 on most shared results.
- StoryDiffusion — StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation (NeurIPS 2024) · better on 3 of 6 shared results
Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.
Closest papers by meaning
- ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing (NeurIPS 2025 · similarity 0.87)
- Stable Cinemetrics : Structured Taxonomy and Evaluation for Professional Video Generation (NeurIPS 2025 · similarity 0.86)
- SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency (NeurIPS 2025 · similarity 0.85)
- MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequences (ICLR 2025 · similarity 0.85)
- Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation (NeurIPS 2026 · similarity 0.85)
- Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners (ICML 2026 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
