AI Paper Atlas

Research map / Video / Video generation

FreeInit: Bridging Initialization Gap in Video Diffusion Models

Tianxing Wu, Chenyang Si, Yuming Jiang, Ziqi Huang, Ziwei Liu

ECCV 2024 · Video › Video generation · approach: Efficient video diffusion models · 72 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
apply FreeInit iterative low-frequency noise refinement at inferenceAnimateDiff · UCF-101 promptsDINO: 85.24 -> 92.01Improved
apply FreeInitAnimateDiff · UCF-101 zero-shotFVD: 1340.96 -> 1032.47Improved
apply FreeInitModelScope · UCF-101 promptsDynamic Degree |Delta UCF|: 3.71 -> 8.22Hurt
add noise reinitialization with Gaussian low-pass filter (ablation)FreeInit on AnimateDiff · UCF-101 promptsDINO: 86.77 -> 92.01Improved
use Gaussian instead of ideal low pass filter in reinitialization (ablation)FreeInit on AnimateDiff · UCF-101 promptsDINO: 87.53 -> 92.01Improved
increase FreeInit iterations (ablation)FreeInit · UCF-101 and MSR-VTTDINOImproved
FreeInit with 2n steps versus vanilla DDIM with 5n steps (ablation)FreeInit · UCF-101DINOImproved
increase low-pass cut-off D0 from 0.25 to 0.5 (ablation)FreeInit on AnimateDiff · UCF-101 promptsDynamic Degree |Delta UCF|: DINO 92.07 -> 93.91; DD diff 1.59 -> 37.78Mixed
apply FreeInit to videos with small fast-moving objectsFreeInit · failure case, waterdrops promptqualitativeHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy