atlas

Research map / Adversarial robustness and security / Backdoor and poisoning

TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors

ICML 2024 · Adversarial robustness and security › Backdoor and poisoning · approach: Backdoors in large multimodal models · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes TERD, a unified-loss trigger reversion plus noise-space input and model detection framework that defends diffusion models against pixel-level backdoor attacks (BadDiffusion, TrojDiff, VillanDiffusion), reporting 100% TPR/TNR on CIFAR-10, CelebA and CelebA-HQ.

Problem

Backdoor attacks on diffusion models cause specific target outputs when a trigger is added to the input noise; existing classification-oriented defenses do not apply, and the prior diffusion-specific defense (Elijah) relies on assumptions that fail for some attacks.

Approach

A unified formulation of backdoor diffusion processes yields an accessible reversed loss; trigger reversion first estimates the trigger using noise from a prior distribution and then refines it through a multi-step differentiable sampler. The reversed trigger defines a backdoor noise distribution N(r, gamma^2) used for per-input likelihood-ratio detection and for model detection via KL-divergence

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Full TERD (trigger estimation + refinement) vs Elijah baseline for trigger reversiontrigger reversion on CIFAR-10 · CIFAR-10 BadDiffusion/TrojDiff/VillanDiffusionl2 distance to original trigger (lower better): 32.90→20.69; 22.60→4.26; 43.03→30.03Helped
Replace Elijah model detection with TERD KL-divergence-based model detectionmodel detection on CIFAR-10 · BadDiffusion, TrojDiff, VillanDiffusionTPR/TNR (%): Elijah TPR 0.00 on TrojDiff vs TERD 100.00Helped
Trigger estimation (TE) alone, without trigger refinement (TR) (ablation)TERD trigger reversion · CIFAR-10 average of attacksl2 distance, TPR, TNR: not quantified in textHurt
Trigger refinement (TR) alone, without trigger estimation (TE) (ablation)TERD trigger reversion · CIFAR-10 average of attacksl2 distance, TPR, TNR: not quantified in textHurt
Vary trigger size (4x4 to 14x14) and poison rate (2% to 20%) (ablation)TERD detection · CIFAR-10 average of attacksinput/model detection TPR/TNR: 100.00 in all settingsNo clear effect
Scale trigger by eta<1 (adaptive attack) with very low eta such as 0.1 for TrojDiff (ablation)TERD model detection · CIFAR-10 adaptive attackTNR (model detection): performance degrades at extremely low etaHurt
Use TERD trigger-based detection on high-resolution data with detector trained on CIFAR-10CelebA and CelebA-HQ attacks · BadDiffusion, TrojDiff, VillanDiffusionTPR/TNR (%): 100.00 in all settingsHelped
Apply TERD to score-based and consistency SDE modelsSDE-based generative models · VillanDiffusion-style backdoors on score-based and consistency modelsTPR/TNR (%): 100.00 in all settingsHelped

Surprising findings

Limitations

Experimental setup

Datasets: CIFAR-10 CelebA CelebA-HQ

Benchmarks: CIFAR-10 CelebA CelebA-HQ

Metrics: TPR TNR l2 distance between reversed and original trigger

Baselines: Elijah

Builds on: Elijah BadDiffusion TrojDiff VillanDiffusion DDIM

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy