Research map / Image generation / Fast diffusion sampling
Posterior Sampling by Combining Diffusion Models with Annealed Langevin Dynamics
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Shows that combining a diffusion model prior (for a warm start) with annealed Langevin dynamics gives polynomial-time posterior sampling for log-concave (globally or locally) priors using only an L^4 score-error bound, with a compressed-sensing corollary and FFHQ-256 inpainting/SR/deblurring experiments.
Problem
Posterior sampling p(x|y) from a noisy linear measurement y=Ax+noise given an approximate prior score; existing diffusion-based heuristics lack guarantees and Langevin needs MGF-accurate scores.
Approach
Use a noise-annealed sequence of intermediate posteriors p(x|y_i), with short Langevin mixing steps between consecutive levels, starting from a diffusion-model sample; for log-concave (or locally log-concave) priors this keeps the process near the prior manifold so only an L^4 score-error bound is needed.
Key results
- In inpainting, with sufficiently small step size, the annealed Langevin refinement surpasses DPS on both L2 distance and FID on 1k FFHQ-256 validation images.
- Across all three tasks, more annealed Langevin time decreases L2 error but increases FID.
- Theory: polynomial-time posterior sampling for alpha-strongly log-concave priors with only an L^4 score-error bound (epsilon_score <= sqrt(alpha)/K_1).
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| increase time devoted to annealed Langevin sampling | annealed Langevin · FFHQ-256 inpainting | L2 distance to ground truth | Helped |
| increase time devoted to annealed Langevin sampling | annealed Langevin · FFHQ-256 inpainting | FID | Hurt |
| increase time devoted to annealed Langevin sampling | annealed Langevin · FFHQ-256 4× super-resolution | L2 distance to ground truth | Helped |
| increase time devoted to annealed Langevin sampling | annealed Langevin · FFHQ-256 4× super-resolution | FID | Hurt |
| increase time devoted to annealed Langevin sampling | annealed Langevin · FFHQ-256 Gaussian deblurring | L2 distance to ground truth | Helped |
| increase time devoted to annealed Langevin sampling | annealed Langevin · FFHQ-256 Gaussian deblurring | FID | Hurt |
| refine DPS reconstructions with annealed Langevin at a sufficiently small step size | annealed Langevin · FFHQ-256 inpainting | L2 distance to ground truth | Helped |
| refine DPS reconstructions with annealed Langevin at a sufficiently small step size | annealed Langevin · FFHQ-256 inpainting | FID | Helped |
Surprising findings
- Experiments show a trade-off: longer annealed Langevin improves L2 but worsens FID, so the method is not uniformly better than DPS.
Limitations
- Theoretical guarantees require (local) log-concavity of the prior, which real image manifolds may not satisfy.
- Experiments are on three linear inverse problems on FFHQ-256 and use DPS for initialization, so gains depend on the heuristic warm start.
Experimental setup
Datasets: FFHQ-256
Benchmarks: FFHQ-256 inpainting FFHQ-256 4x super-resolution FFHQ-256 Gaussian deblurring
Metrics: L2 distance to ground truth FID
Baselines: DPS
Builds on: DPS Langevin dynamics diffusion SDE
Closest papers by meaning
- Divide-and-Conquer Posterior Sampling for Denoising Diffusion priors (NeurIPS 2024 · similarity 0.89)
- Provable Posterior Sampling with Denoising Oracles via Tilted Transport (NeurIPS 2024 · similarity 0.89)
- The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Models (NeurIPS 2024 · similarity 0.88)
- A Mixture-Based Framework for Guiding Diffusion Models (ICML 2025 · similarity 0.88)
- Analyzing and Guiding Zero-Shot Posterior Sampling in Diffusion Models (NeurIPS 2026 · similarity 0.88)
- Consistency Posterior Sampling for Diverse Image Synthesis (CVPR 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
