atlas

Research map / Image generation / Autoregressive and latent generation

AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error

CVPR 2024 · Image generation › Autoregressive and latent generation · approach: Reconstruction-based diffusion image detection · 53 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes AEROBLADE, a training-free detector that flags latent diffusion model images by their low reconstruction error through the LDM's own autoencoder (LPIPS distance, minimum over AEs).

Problem

Detecting images generated by latent diffusion models (e.g., Stable Diffusion, Midjourney) amid growing visual disinformation; existing detectors need extensive training or costly diffusion processes and generalize poorly.

Approach

LDM-generated images lie on the manifold of the generator's autoencoder and are reconstructed with lower error than real images, so the minimum LPIPS distance between an image and its reconstructions from several known AEs gives a training-free detector that needs no denoising.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use AEROBLADE instead of the trained Corvi detectorgenerated-image detection · SD1.1AP: 1.000 -> 0.979No clear effect
use AEROBLADE instead of the trained Corvi detectorgenerated-image detection · SD1.5AP: 1.000 -> 0.978No clear effect
use AEROBLADE instead of the trained Corvi detectorgenerated-image detection · SD2.1AP: 1.000 -> 0.994No clear effect
use AEROBLADE instead of the trained Corvi detectorgenerated-image detection · KD2.1AP: 1.000 -> 0.999No clear effect
use AEROBLADE instead of the trained Corvi detectorgenerated-image detection · MJ4, MJ5, and MJ5.1AP: 1.000 -> 0.999; 1.000 -> 0.997; 1.000 -> 0.996No clear effect
take the minimum reconstruction error across multiple AEs instead of using a single AE (ablation)AEROBLADE · SD1.1, SD1.5, SD2.1, KD2.1, MJ4, MJ5, and MJ5.1AP: 0.959; 0.957; 0.991; 0.996; 0.998; 0.993; 0.994Helped
use LPIPS2 instead of the standard LPIPS distance (ablation)AEROBLADE with minimum reconstruction error · SD1.1, SD1.5, SD2.1, KD2.1, MJ4, MJ5, and MJ5.1AP: 0.979 vs 0.959; 0.978 vs 0.957; 0.994 vs 0.991; 0.999 vs 0.996; 0.999 vs 0.998; 0.997 vs 0.993; 0.996 vs 0.994Mixed
use deeper DDIM inversion and denoising reconstructions instead of AE-only reconstruction (ablation)AEROBLADE · Stable Diffusion 1.5 and 2.1APHurt
use LPIPS (VGG16) instead of alternative distance metrics (ablation)AEROBLADE · SD1.1, SD1.5, SD2.1, KD2.1, MJ4, MJ5, and MJ5.1AP: 0.959; 0.957; 0.991; 0.996; 0.998; 0.993; 0.994Helped
use individual AE reconstruction errors instead of the minimum across AEs (ablation)AEROBLADE · Midjourney imagesAP: 0.999; 0.997; 0.994Mixed

Surprising findings

Limitations

Experimental setup

Datasets: LAION-5B Midjourney Discord images

Benchmarks: LAION-5B-derived generated sets (SD1.1, SD1.5, SD2.1, KD2.1) Midjourney Discord sets (MJ4, MJ5, MJ5.1)

Metrics: AP TPR@5%FPR

Baselines: Gragnaniello et al. Corvi et al. Ojha et al. DIRE SeDIDStat

Builds on: LPIPS latent diffusion models DIRE CLIP interrogator

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy