atlas

Research map / Detection and segmentation / CNN features

LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection

CVPR 2024 · Detection and segmentation › CNN features · approach: Forgery detection · 75 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes LAA-Net, a deepfake detector trained only on real images with pseudo-fakes, combining explicit heatmap and self-consistency attention on vulnerable blending points with an Enhanced FPN, achieving SOTA cross-dataset generalization.

Problem

Detecting high-quality deepfakes with subtle localized blending artifacts, and generalizing to unseen manipulations and datasets, where prior binary classifiers with implicit attention generalize poorly.

Approach

An explicit attention mechanism in a multi-task framework: heatmap regression and self-consistency regression centered on automatically derived "vulnerable points" from blending-boundary masks of pseudo-fakes (no manual annotation, real data only), plus E-FPN that propagates low-level features with redundancy-reducing masking.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use SBI instead of BI pseudo-fake synthesisLAA-Net · CDF2AUC (%): 86.28 -> 95.40Helped
Use SBI instead of BI pseudo-fake synthesisLAA-Net · CDF2AP (%): 56.89 -> 81.08Helped
Add the heatmap branch (ablation)LAA-Net with consistency branch and E-FPN · CDF2AUC (%): 79.87 -> 95.40Helped
Add the consistency branch (ablation)LAA-Net with heatmap branch and E-FPN · CDF2AUC (%): 95.56 -> 95.40No clear effect
Add E-FPN (ablation)LAA-Net with consistency and heatmap branches · CDF2AUC (%): 91.56 -> 95.40Helped
Replace traditional FPN with E-FPN and integrate F(6), F(5), F(4), F(3), and F(2) (ablation)LAA-Net · CDF2AUC (%): 88.35 -> 95.40Helped
Set λ1=10 and λ2=100 instead of λ1=1 and λ2=1 (ablation)LAA-Net · CDF2AUC (%): 90.69 -> 95.40Helped

Surprising findings

Limitations

Experimental setup

Datasets: FaceForensics++ Celeb-DF v2 DFD DFDC DFW

Benchmarks: FaceForensics++ Celeb-DF v2 DFD DFDC DFW

Metrics: AUC AP

Baselines: Xception FaceXRay+BI Multi-attentional RECCE SFDG CADDM SBI AltFreezing UCF AUNet PCL+I2G

Builds on: Self-Blended Images Face X-ray Self-consistency learning (PCL+I2G) Feature Pyramid Network EfficientNet

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy