atlas

Research map / Image generation / Image restoration

FlowIE: Efficient Image Enhancement via Rectified Flow

CVPR 2024 · Image generation › Image restoration · approach: Low-light image enhancement · 23 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes FlowIE, a conditioned rectified flow framework that adapts a pretrained Stable Diffusion prior into a many-to-one flow for image enhancement, using midpoint "mean value sampling" to achieve high quality in under 5 steps.

Problem

Diffusion-based image enhancement methods leverage strong generative priors but require long, costly sampling, making them impractical; existing rectified flow assumes one-to-one noise-to-image pairs and synthetic data, which does not suit real-world enhancement.

Approach

Adapt rectified flow into a many-to-one mapping where any Gaussian noise point flows to a fixed real HQ image, conditioned on a coarse restoration from a pretrained deblurring model via a ControlNet-style branch; at inference, a velocity sampled at a learned midpoint (Lagrange mean value theorem) gives a more accurate direction in few Euler steps.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use FlowIE instead of DiffBIRBFR · CelebA-TestFID: 20.19 -> 19.81Helped
Use FlowIE instead of DiffBIRBSR · RealSRSetMANIQA: 0.5906 -> 0.5953Helped
Remove rectified flow (direct distillation) (ablation)FlowIE · CelebA-TestFID: 19.81 -> 49.74Hurt
Remove rectified flow (direct distillation) (ablation)FlowIE · RealSRSetMANIQA: 0.5953 -> 0.5311Hurt
Remove mean value sampling (ablation)FlowIE · CelebA-TestFID: 19.81 -> 25.19Hurt
Remove mean value sampling (ablation)FlowIE · RealSRSetMANIQA: 0.5953 -> 0.5489Hurt
Remove the initial-stage model (ablation)FlowIE · CelebA-TestFID: 19.81 -> 27.76Hurt
Remove the initial-stage model (ablation)FlowIE · RealSRSetMANIQA: 0.5953 -> 0.5301Hurt

Surprising findings

Limitations

Experimental setup

Datasets: FFHQ ImageNet CelebA-Test LFW-Test CelebChild-Test WIDER-Test RealSRSet Collect-100

Benchmarks: CelebA-Test LFW-Test WIDER-Test CelebChild-Test RealSRSet Collect-100

Metrics: FID IDS PSNR SSIM LPIPS MANIQA FPS

Baselines: GPEN GCFSR GFPGAN VQFR RestoreFormer DMDNet CodeFormer DiffBIR Real-ESRGAN+ BSRGAN SwinIR-GAN FeMaSR

Builds on: rectified flow Stable Diffusion ControlNet SwinIR VQGAN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy