atlas

Research map / Image generation / Autoregressive and latent generation

LaRE^2: Latent Reconstruction Error Based Method for Diffusion-Generated Image Detection

CVPR 2024 · Image generation › Autoregressive and latent generation · approach: Reconstruction-based diffusion image detection · 48 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes LaRE^2, a detector for diffusion-generated images that uses a single-step latent reconstruction error (LaRE) as a feature and refines CNN image features with it via error-guided spatial and channel modules.

Problem

Detecting diffusion-generated images generalizably and efficiently; existing reconstruction-based detectors (DIRE, SeDID) require multi-step DDIM inversion and reconstruction, which is slow and error-accumulating.

Approach

Compute the reconstruction error in latent space with a single denoising step at a fixed timestep (Monte Carlo averaged over noise samples) instead of full DDIM inversion-reconstruction, and use this error map to guide spatial attention and channel gating over CNN image features (EGRE).

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add ESR using LaRE instead of the image-only baseline (ablation)LaRE2 · GenImage, average across 8 generatorsaccuracy: 73.1 -> 81.7Helped
add ESR using LaRE instead of the image-only baseline (ablation)LaRE2 · GenImage, average across 8 generatorsaverage precision: 92.3 -> 97.6Helped
add ECR using LaRE instead of the image-only baseline (ablation)LaRE2 · GenImage, average across 8 generatorsaccuracy: 73.1 -> 78.8Helped
add ECR using LaRE instead of the image-only baseline (ablation)LaRE2 · GenImage, average across 8 generatorsaverage precision: 92.3 -> 94.7Helped
add both ESR and ECR using LaRE instead of the image-only baseline (ablation)LaRE2 · GenImage, average across 8 generatorsaccuracy: 73.1 -> 84.5Helped
add both ESR and ECR using LaRE instead of the image-only baseline (ablation)LaRE2 · GenImage, average across 8 generatorsaverage precision: 92.3 -> 99.5Helped
use class-specific LaRE prompt instead of the generic prompt (ablation)LaRE2 with ESR and ECR · GenImage, average across 8 generatorsaccuracy: +1.4%Helped
use class-specific LaRE prompt instead of the generic prompt (ablation)LaRE2 with ESR and ECR · GenImage, average across 8 generatorsaverage precision: +0.3%Helped
increase the noise ensemble size e (ablation)LaRE2 · GenImageaccuracyHelped
increase the noise ensemble size e (ablation)LaRE2 · GenImage feature extractionruntimeHurt
choose sample step t outside the stable range [150, 300] (ablation)LaRE2 · GenImageperformanceHurt
use LaRE as the only input instead of image features (ablation)generated-image detector · GenImage, average across 8 generatorsaccuracy: 73.1 -> 66.2Hurt

Surprising findings

Limitations

Experimental setup

Datasets: GenImage

Benchmarks: GenImage

Metrics: ACC AP

Baselines: CNNSpot Spec F3Net GramNet DIRE

Builds on: DIRE Latent Diffusion Models CLIP DDIM

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy