atlas

Research map / Adversarial robustness and security / Backdoor and poisoning

Physical Backdoor: Towards Temperature-based Backdoor Attacks in the Physical World

CVPR 2024 · Adversarial robustness and security › Backdoor and poisoning · approach: Backdoors in large multimodal models · 11 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces temperature-controlled physical backdoor attacks (Object-Affecting and Range-Affecting) on thermal infrared object detectors, validated digitally and in two real-world physical scenes using a heated electric trigger.

Problem

Backdoor attacks on thermal infrared object detection (TIOD) remain unexplored, even though TIOD is used in dark and temperature-sensitive settings such as autonomous driving and security monitoring.

Approach

Uses the temperature of a physical heated trigger as the backdoor trigger in thermal infrared imagery, with OAA removing or flipping labels of objects carrying the trigger and RAA using trigger temperature to set the radius of objects affected, so the attack can be switched on and off or scoped by temperature.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the OAA backdoor attack to misclassify cars as personsYOLO v5 · Flir v2 TASR (%): 97.46Helped
Use the RAA backdoor attack to misclassify cars as personsYOLO v5 · FIR DetASR (%): 96.69Helped
Increase OAA poison ratio from 1% to 20% (default) (ablation)YOLO v5 OAA · Flir v2 TASR (%): 52.83 -> 97.87Helped
Use OAA trigger pixel value 64 instead of the default 192 (ablation)YOLO v5 OAA · Flir v2 TASR (%): 97.87 -> 98.21No clear effect
Increase RAA attack radius from 50 to 300 (ablation)YOLO v5 RAA · Flir v2 TASR (%): 77.45 -> 98.19Helped
Use a smaller RAA test radius than the training radius (ablation)YOLO v5 RAA · Flir v2 TASR (%): 97.44Helped
Add temperature-modulated triggering to OAA (ablation)YOLO v5 OAA · Physical parking lotASR (%): 97.83Helped
Add temperature-modulated triggering to RAA (ablation)YOLO v5 RAA · Physical parking lot and traffic intersectionASR (%): 94.32Helped
Prune neurons in deeper layers (ablation)Backdoored YOLO v5 · Flir v2 TASR (%): ASR to 63.33%Hurt
Apply Neural Cleanse trigger reverse engineering (ablation)OAA and RAA · Flir v2 Tanomaly index: 1.218572; 1.767544No clear effect

Surprising findings

Limitations

Experimental setup

Datasets: Flir v2 T FIR Det self-collected physical thermal video

Benchmarks: Flir v2 T FIR Det

Metrics: Attack Success Rate (ASR) Benign Accuracy Fluctuation (BAF) mAP

Baselines: Pruning Fine-Pruning Neural Cleanse

Builds on: YOLO v5 Neural Cleanse Fine-Pruning

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy