Research map / Video / Video generation
VACE: All-in-One Video Creation and Editing
Zeyinzi Jiang, Zhen Han, Chaojie Mao, Jingfeng Zhang, Yulin Pan, Yu Liu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use Context Adapter tuning (Res-Tuning) instead of full fine-tuning (ablation) | VACE · VACE-Benchmark (LTX-Video based, validation loss) | training loss convergence | Improved |
| distribute context blocks evenly instead of continuous shallow blocks (ablation) | VACE Context Adapter · VACE-Benchmark (LTX-Video based, validation loss) | validation loss | Improved |
| increase number of context blocks (1/4, 1/2, all) (ablation) | VACE Context Adapter · VACE-Benchmark (LTX-Video based, validation loss) | validation loss | Improved |
| add Concept Decouple module (ablation) | VACE · VACE-Benchmark (LTX-Video based, validation loss) | validation loss | Improved |
| unified model vs task-specific open-source methods on I2V, inpainting, outpainting, depth, pose, optical flow | VACE · VACE-Benchmark | VBench eight indicators | Improved |
| small LTX-based VACE vs commercial models on reference-to-video | VACE · VACE-Benchmark R2V | VBench indicators | Mixed |
Closest papers by meaning
- BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models (CVPR 2024 · similarity 0.85)
- DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation (CVPR 2025 · similarity 0.85)
- WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model (CVPR 2025 · similarity 0.85)
- VDT: General-purpose Video Diffusion Transformers via Mask Modeling (ICLR 2024 · similarity 0.85)
- CCEdit: Creative and Controllable Video Editing via Diffusion Models (CVPR 2024 · similarity 0.85)
- VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control (ICLR 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
