atlas

Research map / Image generation / Image restoration

Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge

ICML 2024 · Image generation › Image restoration · approach: Diffusion-based universal restoration · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes the Generalized Ornstein-Uhlenbeck Bridge (GOUB), which applies Doob's h-transform to a generalized OU process to get a point-to-point diffusion bridge from low-quality to high-quality images, plus a Mean-ODE sampler, evaluated on inpainting, deraining and 4x super-resolution.

Problem

Diffusion models for image restoration usually map noise to data or need task-specific degradation priors; existing bridge models either need costly iterative likelihood approximation or ignore the choice of diffusion process, limiting restoration quality.

Approach

Use the mean-reverting generalized OU process as the base forward SDE and apply Doob's h-transform with the terminal low-quality image as the endpoint, removing terminal variance so the diffusion is a point-to-point bridge with closed-form marginals; train by maximum likelihood (ELBO) with a noise-prediction parameterization and an L1 loss, and sample with a Mean-ODE that drops the Brownian term.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use Mean-ODE instead of Score-ODE (ablation)GOUB · Image inpaintingPSNR: 18.23 -> 31.39Helped
use Mean-ODE instead of Score-ODE (ablation)GOUB · Image derainingPSNR: 13.64 -> 34.56Helped
use Mean-ODE instead of Score-ODE (ablation)GOUB · Image 4× super-resolutionPSNR: 28.14 -> 28.50Helped
use Mean-ODE instead of Score-ODE (ablation)GOUB · Image inpaintingFID: 161.54 -> 12.24Helped
use Mean-ODE instead of Score-ODE (ablation)GOUB · Image derainingFID: 191.15 -> 32.83Helped
use Mean-ODE instead of Score-ODE (ablation)GOUB · Image 4× super-resolutionFID: 25.51 -> 22.14Helped
use GOUB instead of VEB or VPBimage restoration bridge model · CelebA-HQ inpaintingPSNR: 27.75 -> 28.98; 27.32 -> 28.98Helped
use GOUB instead of VEB or VPBimage restoration bridge model · Rain100H derainingPSNR: 30.39 -> 31.96; 30.89 -> 31.96Helped
use GOUB instead of VEB or VPBimage restoration bridge model · DIV2K 4× super-resolutionPSNR: 24.21 -> 26.89; 25.40 -> 26.89Helped
use Mean-ODE instead of GOUB (SDE)GOUB · CelebA-HQ inpaintingPSNR: 28.98 -> 31.39Helped
use Mean-ODE instead of GOUB (SDE)GOUB · Rain100H derainingPSNR: 31.96 -> 34.56Helped
use Mean-ODE instead of GOUB (SDE)GOUB · DIV2K 4× super-resolutionLPIPS: 0.220 -> 0.328Hurt

Surprising findings

Limitations

Experimental setup

Datasets: CelebA-HQ Rain100H DIV2K

Benchmarks: CelebA-HQ Rain100H DIV2K

Metrics: PSNR SSIM LPIPS FID

Baselines: PromptIR DDRM IR-SDE MPRNet M3SNet-32 MAXIM MHNet VEB VPB

Builds on: score-based SDE DDPM Doob's h-transform IR-SDE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy