atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Preserving Fairness Generalization in Deepfake Detection

CVPR 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Data augmentation and generalization bias · 94 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a fairness-generalization method for deepfake detection combining disentangled demographic/forgery features, fair learning with a bi-level fairness loss, and sharpness-aware loss flattening, trained on FF++ and tested cross-domain.

Problem

Deepfake detectors show demographic performance disparities that do not persist fairly under cross-domain testing; existing fair loss methods (DAW-FDD) fail to generalize fairness to unseen forgeries.

Approach

Jointly disentangles domain-agnostic forgery and demographic features, fuses them via AdaIN for a fair classifier with a bi-level (inter- and intra-subgroup) fairness loss, and flattens the loss landscape with sharpness-aware minimization.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the proposed framework instead of DAW-FDDXception deepfake detector · Celeb-DFFFPR: 11.69%Helped
Use the proposed framework instead of DAW-FDDXception deepfake detector · DFDFFPR: 7.94%Helped
Use the proposed framework instead of DAW-FDDXception deepfake detector · DFDCFDP: 8.90%Helped
Add reconstruction loss (ablation)disentanglement learning module · Celeb-DFFFPR: 5.47%Helped
Add reconstruction loss (ablation)disentanglement learning module · Celeb-DFAUC: +2.69%Helped
Add contrastive loss (ablation)disentanglement learning module · Celeb-DFFFPR: 6.32%Helped
Add contrastive loss (ablation)disentanglement learning module · Celeb-DFAUC: +4.03%Helped
Use demographic distribution-aware margin loss instead of cross-entropy (ablation)disentanglement learning module · FF++FFPR: 5.95%Helped
Use demographic distribution-aware margin loss instead of cross-entropy (ablation)disentanglement learning module · FF++AUC: +0.23%Helped
Add loss flattening (ablation)proposed method · Celeb-DFFFPR: 7.94%Helped
Add loss flattening (ablation)proposed method · DFDCFFPR: 4.18%Helped
Add feature fusion (ablation)proposed method · Celeb-DFFFPR: 4.10%Helped

Surprising findings

Limitations

Experimental setup

Datasets: FaceForensics++ DeepfakeDetection (DFD) DFDC Celeb-DF

Benchmarks: FaceForensics++ DFD DFDC Celeb-DF

Metrics: AUC FFPR FMEO FDP FOAE

Baselines: DAW-FDD UCF Ori (Xception with cross-entropy)

Builds on: DAW-FDD UCF sharpness-aware minimization AdaIN Xception

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy