atlas

Research map / Image generation / Autoregressive and latent generation

Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for now

CVPR 2024 · Image generation › Autoregressive and latent generation · approach: Generalizable fake image detection · 28 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Shows that generated images carry geometric defects by training classifiers on derived geometry cues (object-shadow pairs, perspective fields, line segments) that never see pixels, after prequalifying generated images to fool a pixel-based ResNet-50.

Problem

Generated images look realistic to people and to pixel-level detectors, but may still violate projective geometry (vanishing points, perspective, shadows); the paper asks whether this can be detected reliably from geometric features alone.

Approach

Prequalify generated images so that a pixel-based ResNet-50 is fooled, then train classifiers that see only derived geometry (object-shadow masks, perspective fields, line segments via PointNet) to separate real from generated images, so detection relies on geometric errors rather than signal artifacts.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use line segment cues rather than pixel signals to classify imagesKandinsky-v3-trained classifier · Indoor unconfident test setAUC: 0.51 -> 0.82Helped
Use perspective field cues rather than pixel signals to classify imagesKandinsky-v3-trained classifier · Outdoor unconfident test setAUC: 0.51 -> 0.84Helped
Use perspective field and object-shadow cues rather than pixel signals to classify imagesKandinsky-v3-trained classifier · Combined unconfident test setAUC: 0.49 -> 0.80Helped
Train on Kandinsky-v3 and test on other generatorsGeometry cue classifiers · Indoor and outdoor images from unseen generatorsAUCMixed

Surprising findings

Limitations

Experimental setup

Datasets: LSUN Berkeley Deep Drive 100K Mapillary Vistas Kandinsky-v3 generated images Stable Diffusion XL generated images DeepFloyd IF generated images PixArt-α generated images recent social media images (May 2023 to March 2024)

Benchmarks: Kandinsky-v3 easy/unconfident/misclassified test sets (indoor, outdoor, combined) recent timestamp real/generated test set out-of-distribution generators (SDXL, DeepFloyd, PixArt-α, DALL-E 3, Adobe Firefly)

Metrics: AUC accuracy ROC curves Grad-CAM saliency

Baselines: ResNet-50 pixel prequalifier SOTA local signal-based detectors

Builds on: Perspective Fields Deep LSD PointNet SSISv2 ResNet

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy