atlas

Research map / Image generation / Image restoration

Laplacian-guided Entropy Model in Neural Codec with Blur-dissipated Synthesis

CVPR 2024 · Image generation › Image restoration · approach: Perceptual diffusion image compression · 7 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a neural image codec with a non-isotropic blurring-diffusion decoder conditioned on a quantized latent, plus a channel-wise entropy model using a Transformer with learnable Laplacian-shaped relative positional encoding per channel chunk.

Problem

Diffusion-based decoders in learned image compression lack image-specific inductive bias, limiting perceptual quality; entropy models also trade off compression efficiency against decoding speed.

Approach

Replace the isotropic DDPM decoder with a blurring diffusion model that diffuses frequency components at different rates (coarse-to-fine generation), and pair it with an uneven channel-chunked entropy model whose Transformer global context uses a learnable Laplacian relative position encoding adapted per chunk.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
increase maximum blur from σB,max=0 to σB,max=25 (ablation)Blurring diffusion decoder · KodakFID: 3.94 -> 3.45Helped
set maximum blur to σB,max=5 instead of σB,max=0 (ablation)Blurring diffusion decoder · KodakFID: 3.94 -> 3.78Helped
set maximum blur to σB,max=15 instead of σB,max=0 (ablation)Blurring diffusion decoder · KodakFID: 3.94 -> 3.56Helped
add relative positional encoding (ablation)Transformer entropy model · Kodakbpp: 0.2811 -> 0.2643Helped
replace relative positional encoding with diamond relative positional encoding (ablation)Transformer entropy model · Kodakbpp: 0.2643 -> 0.2512Helped
add Laplacian-shaped positional encoding instead of diamond relative positional encoding (ablation)Transformer entropy model · Kodakbpp: 0.2512 -> 0.2347Helped
use parallel instead of serial local and global context (ablation)Proposed entropy model · KodakDecoding latency (ms): > 103 -> 196.3Helped
use parallel instead of serial local and global context (ablation)Proposed entropy model · KodakBD-Rate: -9.38 -> -8.25Hurt
add global spatial context to local spatial contextProposed entropy model · KodakBD-Rate: -5.71 -> -7.89Helped

Surprising findings

Limitations

Experimental setup

Datasets: DIV2K Flickr2K CLIC

Benchmarks: Kodak CLIC2020

Metrics: PSNR FID LPIPS BD-rate bpp inference latency

Baselines: HiFiC Multi-Realism DIRAC CDC VVC-Intra (VTM) DGML NSC MEM

Builds on: blurring diffusion model CDC Entroformer ELIC Swin Transformer

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy