atlas

Research map / Image generation / Super-resolution

CDFormer: When Degradation Prediction Embraces Diffusion Model for Blind Image Super-Resolution

CVPR 2024 · Image generation › Super-resolution · approach: Blind super-resolution · 25 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CDFormer, a blind super-resolution method that learns a Content Degradation Prior (CDP) with a diffusion-based estimator operating on a 1-D latent vector and injects it into a transformer SR network.

Problem

Blind image super-resolution with complex real-world degradations: prior methods estimate only kernel or degradation information and ignore content details, while diffusion-based SR is slow and produces texture errors.

Approach

Use a diffusion model as a low-cost estimator (4 sampling steps, ~3M params) that recreates a one-dimensional Content Degradation Prior from LR images alone, trained in two stages with a GT encoder on HR/LR pairs, and inject the prior into a transformer SR network via learnable affine modulation (CDIM) and an interflow of spatial/channel attention and depth-wise convolution branches.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add degradation prior to the no-prior model (ablation)CDFormer · Set5, ×4, kernel width 1.2PSNR: 32.074 -> 32.372Helped
Add content prior to the no-prior model (ablation)CDFormer · Set5, ×4, kernel width 1.2PSNR: 32.074 -> 32.451Helped
Use both degradation and content priors instead of no prior (ablation)CDFormer · Set5, ×4, kernel width 1.2PSNR: 32.074 -> 32.564Helped
Add degradation prior to the no-prior model (ablation)CDFormer · Set5, ×4, kernel width 2.4PSNR: 32.006 -> 32.167Helped
Add content prior to the no-prior model (ablation)CDFormer · Set5, ×4, kernel width 2.4PSNR: 32.006 -> 32.287Helped
Use both degradation and content priors instead of no prior (ablation)CDFormer · Set5, ×4, kernel width 2.4PSNR: 32.006 -> 32.393Helped
Generate CDP with the Stage 2 diffusion model rather than use Stage 1 (ablation)CDFormer · Urban100, ×4, kernel width 0PSNR: 26.945 -> 27.210Helped
Generate CDP with the Stage 2 diffusion model rather than use Stage 1 (ablation)CDFormer · Urban100, ×4, kernel width 1.2PSNR: 26.923 -> 27.058Helped
Use CDFormer instead of DCLSBlind image super-resolution · Urban100, ×4, kernel width 1.2, noise-freePSNR: 26.50 -> 27.21Helped

Surprising findings

Limitations

Experimental setup

Datasets: DIV2K Flickr2K

Benchmarks: Set5 Set14 B100 Urban100

Metrics: PSNR SSIM FID LPIPS

Baselines: SR3 StableSR DCLS DASR KDSR RCAN

Builds on: DASR KDSR DCLS DiffIR DDPM

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy