atlas

Research map / Adversarial robustness and security / Attacks on text and graphs

CNCA: Toward Customizable and Natural Generation of Adversarial Camouflage for Vehicle Detectors

NeurIPS 2024 · Adversarial robustness and security › Attacks on text and graphs · approach: Physical adversarial patches and camouflage · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Generates natural, customizable adversarial vehicle camouflage by optimizing an adversarial feature added to a text-prompt embedding of a pretrained Stable Diffusion model, with norm clipping to trade off naturalness and attack strength.

Problem

Existing physical adversarial camouflage attacks against vehicle detectors optimize textures at the pixel level, producing conspicuous patterns that humans easily notice, and cannot be customized to environments.

Approach

Optimize an adversarial feature vector concatenated with a text prompt embedding that conditions a pretrained text-to-image diffusion model to generate UV-map camouflage textures; clip the adversarial feature's norm to balance naturalness and attack success.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CNCA instead of the strongest baseline ACTIVEVehicle camouflage attack · Digital evaluation, total across detectorsAP@0.5: 0.504 -> 0.495Helped
Use CNCA instead of ACTIVEVehicle camouflage attack · YOLOFAP@0.5: 0.577 -> 0.538Helped
Use CNCA instead of DTAVehicle camouflage attack · DDTRAP@0.5: 0.402 -> 0.436Hurt
Use CNCA instead of ACTIVEVehicle camouflage attack · DRCNAP@0.5: 0.534 -> 0.536No clear effect
Use CNCA instead of ACTIVEVehicle camouflage attack · SRCNAP@0.5: 0.484 -> 0.470Helped
Use CNCA instead of ACTIVEVehicle camouflage attack · FrRCNAP@0.5: 0.520 -> 0.504Helped
Generate camouflage with CNCA rather than a normal car texturePhysical vehicle evaluation · Physical evaluation across YOLOv3, YOLOX, SSD, CenterNet, and RetinaNetAP@0.5Helped
Use diffusion-based CNCA camouflage rather than DTA camouflageVehicle camouflage · Subjective naturalness evaluationNaturalness score: 1.86 ± 0.98 -> 2.84 ± 1.09Helped
Increase the adversarial-feature clipping threshold (ablation)CNCA · Prompt yellow black graffitiAP@0.5: 0.606, 0.449, 0.479, 0.481, 0.520Mixed
Increase the adversarial-feature clipping threshold (ablation)CNCA · Prompt yellow black graffitiNaturalness score: 4.79, 3.54, 3.33, 1.46, 1.71Hurt

Surprising findings

Limitations

Experimental setup

Datasets: Carla simulator generated vehicle images (Audi E-Tron) LAION-5B (diffusion model pretraining) COCO (detector training)

Benchmarks: Carla-generated vehicle test set physical 1:12 scaled Audi E-Tron evaluation

Metrics: AP@0.5 naturalness score (1-5 subjective rating)

Baselines: DAS FCA DTA ACTIVE Random camouflage Normal car texture

Builds on: Stable Diffusion DTA ACTIVE PGD Pytorch3D

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy