Research map / Image generation / Fast diffusion sampling
Analyzing and Guiding Zero-Shot Posterior Sampling in Diffusion Models
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Analyzes zero-shot diffusion posterior samplers (DPS, ΠGDM, DiffPIR) under a Gaussian prior, derives closed-form spectral transfer functions, and uses them to design guidance weights that outperform heuristics.
Problem
Guidance/weighting hyperparameters in zero-shot diffusion posterior samplers for linear inverse problems are chosen heuristically, with no principled account of prior, observation, and diffusion dynamics.
Approach
Under a Gaussian, shift-invariant prior and linear degradation, the DDIM-based DPS update and the ideal posterior sampler reduce to per-frequency scalar transfer functions; guidance weights are then chosen by minimizing a Wasserstein-2 distance to the true Gaussian posterior, in a method-agnostic way.
Key results
- On FFHQ with LPF (V=0.1, sigma_y=0.1), spectral weights for DPS at 100 steps reach PSNR 27.82 and FID 41.31 versus DPS heuristic PSNR 18.31 and FID 62.68.
- On fastMRI LPF degradation at 50 steps, spectral weights give PSNR 23.20 versus 17.98 for DPS heuristic.
- On the synthetic Gaussian setting, the spectral recommendation consistently yields lower Wasserstein-2 distance than hand-crafted DPS weights across step counts.
Surprising findings
- Optimal spectral guidance weights increase toward the end of the reverse process, opposite to the DPS heuristic which grows as the measurement error shrinks.
- DiffPIR recommendations for small step counts slightly surpass the exact Gaussian posterior denoiser in Wasserstein-2 distance.
Limitations
- Analysis relies on Gaussian prior and shift-invariant covariance and degradation operators.
- Neural denoisers used on real datasets introduce approximation error beyond the closed-form analysis.
- Realization-specific optimization requires solving a separate problem per observation.
Experimental setup
Datasets: FFHQ 256x256 ImageNet 256x256 fastMRI single-coil knee
Benchmarks: FFHQ 256x256 ImageNet 256x256 fastMRI
Metrics: PSNR SSIM LPIPS FID Wasserstein-2 distance
Baselines: DPS heuristic weights ΠGDM DiffPIR DAPS
Builds on: DPS DDIM ΠGDM DiffPIR DAPS
Closest papers by meaning
- Divide-and-Conquer Posterior Sampling for Denoising Diffusion priors (NeurIPS 2024 · similarity 0.92)
- InvFusion: Bridging Supervised and Zero-shot Diffusion for Inverse Problems (NeurIPS 2025 · similarity 0.91)
- Coupled Data and Measurement Space Dynamics for Enhanced Diffusion Posterior Sampling (NeurIPS 2025 · similarity 0.91)
- Improving Diffusion Posterior Samplers with Lagged Temporal Corrections for Image Restoration (NeurIPS 2026 · similarity 0.91)
- A Variational Perspective on Solving Inverse Problems with Diffusion Models (ICLR 2024 · similarity 0.91)
- Provable Posterior Sampling with Denoising Oracles via Tilted Transport (NeurIPS 2024 · similarity 0.90)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
