atlas

Research map / Adversarial robustness and security / Backdoor and poisoning

Data Poisoning based Backdoor Attacks to Contrastive Learning

CVPR 2024 · Adversarial robustness and security › Backdoor and poisoning · approach: Trigger-based backdoor attacks · 18 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CorruptEncoder, a theory-guided data poisoning backdoor attack on contrastive learning that embeds reference objects and triggers into background images so random crops align them, plus a localized-cropping defense.

Problem

Data poisoning backdoor attacks (DPBAs) against contrastive learning pre-training achieve limited attack success, especially with few reference images and small poisoning ratios on complex datasets like ImageNet.

Approach

Craft poisoned images by embedding a reference object and a trigger into a background image at positions and sizes derived theoretically (background about twice the object size, object at corners, trigger at center of remaining area), so that two random crops capture the object and trigger respectively and contrastive learning associates them.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CorruptEncoder instead of PoisonedEncoderBackdoor attack with MoCo-v2 on ImageNet100-A · ImageNet100-AASR (%): 76.7 -> 96.2Helped
Use CorruptEncoder instead of PoisonedEncoderBackdoor attack with MoCo-v2 on ImageNet100-B · ImageNet100-BASR (%): 53.2 -> 89.9Helped
Use CorruptEncoder instead of PoisonedEncoderBackdoor attack with MoCo-v2 on Pets · PetsASR (%): 45.8 -> 72.1Helped
Use CorruptEncoder instead of PoisonedEncoderBackdoor attack with MoCo-v2 on Flowers · FlowersASR (%): 44.4 -> 89Helped
Add poisoned images using reference objects and triggers placed in random backgroundsCorruptEncoder · ImageNet100-BBA (%): 60.8 -> 61.2No clear effect
Replace random cropping with localized cropping (ablation)CorruptEncoder · ImageNet100-BASR (%): 89.9 -> 0.9Hurt
Replace random cropping with localized cropping (ablation)CorruptEncoder · ImageNet100-BBA (%): 61.2 -> 56.3Hurt
Remove random cropping (ablation)CorruptEncoder · ImageNet100-BASR (%): 89.9 -> 2Hurt
Remove random cropping (ablation)CorruptEncoder · ImageNet100-BBA (%): 61.2 -> 31.1Hurt
Replace random cropping with ContrastiveCrop (ablation)CorruptEncoder · ImageNet100-BASR (%): 89.9 -> 90.8No clear effect
Remove data augmentations other than random cropping (ablation)CorruptEncoder · ImageNet100-BASR (%): 89.9 -> 69.3Hurt

Surprising findings

Limitations

Experimental setup

Datasets: ImageNet100-A ImageNet100-B Pets Flowers Places365

Benchmarks: ImageNet100-A ImageNet100-B Pets Flowers

Metrics: attack success rate clean accuracy backdoored accuracy

Baselines: SSL-Backdoor CTRL PoisonedEncoder ContrastiveCrop CompRess

Builds on: MoCo-v2 SSL-Backdoor PoisonedEncoder CTRL ContrastiveCrop

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy