atlas

Research map / Image generation / Image restoration

DiffFPR: Diffusion Prior for Oversampled Fourier Phase Retrieval

ICML 2024 · Image generation › Image restoration · approach: Pansharpening and spectral fusion

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Combines a pretrained DDIM diffusion prior with the RAAR iterative phase-retrieval engine, using damped measurement-guided updates on the Tweedie estimate, to solve oversampled multi-channel Fourier phase retrieval.

Problem

Oversampled Fourier phase retrieval for color images, where trivial/equivalent solutions (channel orientation misalignment, 180° rotation, sign ambiguity) make iterative methods like RAAR recover channels with mismatched orientations.

Approach

Insert RAAR iterations on the Tweedie estimate x̂0(xt) inside each DDIM sampling step, with a damped update weighted by sqrt(alpha_t), so the diffusion prior pulls the iterate onto the clean image manifold and corrects channel orientation, instead of DPS-style gradient guidance.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the diffusion prior and measurement-guided RAAR to RAARRAAR · FFHQ, σy=0.00PSNR: 22.50 -> 37.24Helped
add the diffusion prior and measurement-guided RAAR to RAARRAAR · ImageNet, σy=0.00PSNR: 21.80 -> 31.76Helped
add the diffusion prior and measurement-guided RAAR to RAARRAAR · FFHQ, σy=0.01PSNR: 12.74 -> 29.17Helped
add the diffusion prior and measurement-guided RAAR to RAARRAAR · ImageNet, σy=0.01PSNR: 12.80 -> 25.94Helped
add the diffusion prior and measurement-guided RAAR to RAARRAAR · FFHQ, σy=0.05PSNR: 12.51 -> 22.15Helped
add the diffusion prior and measurement-guided RAAR to RAARRAAR · ImageNet, σy=0.05PSNR: 12.66 -> 19.81Helped
replace the inner RAAR engine with HIO (ablation)DiffFPR · FFHQ, σy=0.00PSNR: 37.24 -> 36.28Hurt
replace the inner RAAR engine with HIO (ablation)DiffFPR · FFHQ, σy=0.01PSNR: 29.17 -> 23.01Hurt
replace the inner RAAR engine with HIO (ablation)DiffFPR · FFHQ, σy=0.05PSNR: 22.15 -> 14.08Hurt
use post-projection instead of measurement guidance before sampling (ablation)DiffFPR · FFHQ, σy=0.00PSNR: degraded by 15.46dBHurt
increase inner RAAR iterations from 1 to 2 (ablation)DiffFPR with 500 diffusion steps · FFHQ, σy=0.00PSNR: 32.29 -> 44.44Helped
increase inner RAAR iterations from 2 to 4 (ablation)DiffFPR with 500 diffusion steps · FFHQ, σy=0.00PSNR: 44.44 -> 49.98Helped

Surprising findings

Limitations

Experimental setup

Datasets: FFHQ 256x256 ImageNet 256x256

Benchmarks: FFHQ ImageNet

Metrics: PSNR SSIM LPIPS

Baselines: RAAR DPS HIO DIP SIREN E2E CDM

Builds on: RAAR DDIM Diffusion Posterior Sampling (DPS) Douglas-Rachford splitting

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy