atlas

Research map / Image generation / Image restoration

ID-Blau: Image Deblurring by Implicit Diffusion-based reBLurring AUgmentation

CVPR 2024 · Image generation › Image restoration · approach: Image deblurring · 22 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes ID-Blau, a pixel-wise blur-condition-conditioned diffusion reblurring model that synthesizes diverse blurred images from sharp GoPro images to augment deblurring training, improving four deblurring models.

Problem

Image deblurring has been advanced mainly through architecture design; data augmentation for deblurring is understudied, and GAN-based blur augmentation is uncontrollable and unstable.

Approach

Parameterize blur as a pixel-wise continuous blur condition map (unit motion orientation plus normalized magnitude derived from averaged optical flow) and train a conditional DDPM/DDIM reblurring model on it, so arbitrary blur conditions can be sampled to create unseen blurred training pairs.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add ID-Blau augmentation to FFTformerFFTformer · GoPro testPSNR: +0.15dBHelped
Add ID-Blau augmentation to FFTformerFFTformer · HIDEPSNR: +0.32dBHelped
Add ID-Blau augmentation to StripformerStripformer · RealBlur-JPSNR: +1.29dBHelped
Add ID-Blau augmentation to StripformerStripformer · RealBlur-RPSNR: +1.22dBHelped
Rotate blur orientations by 30°, 60°, 90°, 120°, or a random angle (ablation)MIMO-UNet with ID-Blau augmentation · GoProPSNR: 31.22 -> 31.99; 31.22 -> 32.00; 31.22 -> 31.97; 31.22 -> 31.95; 31.22 -> 31.96Helped
Shift the blur-magnitude distribution peak to larger values (ablation)MIMO-UNet with ID-Blau augmentation · GoProPSNRHurt
Increase the number of ID-Blau augmented samples (ablation)MIMO-UNet with ID-Blau augmentation · GoProPSNR: 0.53dB to 0.87dBHelped
Use ID-Blau augmentation at matched training iterations (ablation)MIMO-UNet · GoProPSNRHelped
Remove the diffusion process from ID-Blau (ablation)MIMO-UNet with ID-Blau · GoProPSNR: 31.22 -> 31.79Helped
Add the diffusion process to ID-Blau (ablation)MIMO-UNet with ID-Blau† · GoProPSNR: +0.23dBHelped
Add ID-Blau augmentation instead of BGAN augmentation (ablation)DBGAN · GoProPSNR: 30.92 -> 31.57Helped
Add the diffusion process to ID-Blau (ablation)DBGAN with ID-Blau† · GoProPSNR: 31.57 -> 31.67Helped

Surprising findings

Limitations

Experimental setup

Datasets: GoPro HIDE RealBlur-J RealBlur-R

Benchmarks: GoPro HIDE RealBlur-J RealBlur-R

Metrics: PSNR SSIM

Baselines: MIMO-UNet+ Restormer Stripformer FFTformer BGAN DBGAN

Builds on: DDPM DDIM GoPro blur accumulation dataset BGAN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy