atlas

Research map / Image generation / Fast diffusion sampling

DreamPropeller: Supercharge Text-to-3D Generation with Parallel Sampling

CVPR 2024 · Image generation › Fast diffusion sampling · approach: Distillation for few-step generation · 9 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

DreamPropeller generalizes Picard iterations to parallelize score-distillation text-to-3D pipelines (SDS/VSD over NeRF, DMTet, SDF, 3D Gaussian Splatting), achieving about 4.2-4.7x wall-clock speedup at similar quality.

Problem

Score-distillation text-to-3D generation (SDS/VSD) is very slow because gradient-based optimization of 3D representations requires many sequential iterations, and standard Picard iteration cannot handle Adam momentum or changing parameter dimensions.

Approach

Generalize Picard iterations to non-ODE sequential computations (Adam momentum updates and dimension-changing 3D Gaussian splitting/pruning) via a pseudo-inverse formulation, parallelize the expensive SDS/VSD gradient computations across GPUs in a sliding window with an adaptive EMA convergence threshold.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Wrap DreamFusion with DreamPropellerDreamFusion · DreamFusion gallery (30 prompts)Runtime: 8080 -> 1910 s; 4.22xHelped
Wrap Magic3D with DreamPropellerMagic3D · DreamFusion gallery (30 prompts)Runtime: 13470 -> 3230 s; 4.17xHelped
Wrap TextMesh with DreamPropellerTextMesh · DreamFusion gallery (30 prompts)Runtime: 7690 -> 1830 s; 4.18xHelped
Wrap DreamGaussian with DreamPropellerDreamGaussian · DreamFusion gallery (30 prompts)Runtime: 700 -> 150 s; 4.67xHelped
Wrap ProlificDreamer with DreamPropellerProlificDreamer · DreamFusion gallery (30 prompts)Runtime: 7390 -> 3710 s; 4.69xHelped
Wrap DreamFusion with DreamPropellerDreamFusion · DreamFusion gallery (30 prompts)R-Precision: 82.70 -> 79.57Hurt
Wrap Magic3D with DreamPropellerMagic3D · DreamFusion gallery (30 prompts)R-Precision: 88.45 -> 87.18Hurt
Wrap TextMesh with DreamPropellerTextMesh · DreamFusion gallery (30 prompts)R-Precision: 88.06 -> 84.43Hurt
Wrap DreamGaussian with DreamPropellerDreamGaussian · DreamFusion gallery (30 prompts)R-Precision: 83.28 -> 83.85Helped
Wrap ProlificDreamer with DreamPropellerProlificDreamer · DreamFusion gallery (30 prompts)R-Precision: 94.11 -> 96.12Helped
Use a window size of 7 rather than smaller or larger windows (ablation)DreamPropeller · DreamFusion gallery (30 prompts)SpeedupMixed
Use adaptive thresholding with γ < 1 instead of γ = 1 (ablation)DreamPropeller · DreamFusion gallery (30 prompts)SpeedupHelped

Surprising findings

Limitations

Experimental setup

Datasets: DreamFusion gallery prompts (30) ImageNet 2012 validation set (for FID reference)

Benchmarks: DreamFusion gallery prompts (30 prompts)

Metrics: CLIP R-Precision CLIP FID wall-clock runtime speedup

Baselines: DreamFusion Magic3D TextMesh DreamGaussian ProlificDreamer

Builds on: Picard iterations Shih et al. parallel sampling of diffusion models Score Distillation Sampling Variational Score Distillation 3D Gaussian Splatting

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy