AI Paper Atlas

Research map / Image generation / Super-resolution

SPIRE: Semantic Prompt-Driven Image Restoration

Chenyang QI, Zhengzhong Tu, Keren Ye, Mauricio Delbracio, Peyman Milanfar, Qifeng Chen, Hossein Talebi

ECCV 2024 · Image generation › Super-resolution · approach: Perceptual and real-world SR · 26 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add semantic prompt and restoration prompt to ControlNet-SR (ablation)ControlNet-SR · MS-COCO parameterized degradationFID: 13.65 -> 12.14Improved
add modulation fusion layer on skip features (ablation)ControlNet with prompts · MS-COCO parameterized degradationFID: 12.14 -> 11.34Improved
also modulate backbone upsampling features f_up (ablation)modulation fusion layer · MS-COCO parameterized degradationFID: 11.34 -> 11.21No clear effect
embed degradation parameters (e.g. sigma) in restoration prompt (ablation)SPIRE · MS-COCO parameterized degradationFID: 11.58 -> 11.34Improved
add semantic prompt to the image-to-image model (ablation)SPIRE baseline with modulation layer · MS-COCO parameterized degradationFID: 13.60 -> 11.71Mixed
zero-shot combination of semantic prompt with existing models via CLIP or SDEditDiffBIR · MS-COCO parameterized degradationLPIPS: 0.302 -> 0.365 (DiffBIR vs DiffBIR + CLIP)Hurt
use detailed full semantic prompt instead of short prompt (ablation)SPIRE · RealPhoto60MUSIQ: 61.68 -> 67.82Improved
use unmatched long semantic prompt instead of short prompt (ablation)SPIRE · RealPhoto60MUSIQ: 61.68 -> 67.54 (short -> unmatched uses 60.27 vs full 67.82 per column order)Mixed
use blind prompt Remove all degradation instead of manual deblur prompt (ablation)SPIRE · RealPhoto60MUSIQ: 35.82 -> 61.68Improved
increase deblur strength in restoration prompt (ablation)SPIRE · RealPhoto60MUSIQ: 35.82 -> 49.98 (0.6 -> 2.0)Improved
finetune SPIRE on StableSR training set (ablation)SPIRE without text · DIV2K testsetFID: 28.80 -> 22.45Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy