atlas

Research map / Adversarial robustness and security / Backdoor and poisoning

Adversarial Backdoor Attack by Naturalistic Data Poisoning on Trajectory Prediction in Autonomous Driving

CVPR 2024 · Adversarial robustness and security › Backdoor and poisoning · approach: Backdoors in large multimodal models · 18 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a black-box, clean-label backdoor data-poisoning attack on trajectory prediction models for autonomous driving, using perturbed attacking-vehicle trajectories as triggers disguised by bi-level optimized lane transformations.

Problem

Trajectory prediction models in autonomous driving are vulnerable to attacks, but prior work only studied inference-time attacks; training-time backdoor poisoning of these models was unexplored.

Approach

Triggers are crafted by perturbing the trajectory of the closest attacking vehicle toward a malicious future, then made stealthy and clean-label by transforming the lane layout via a bi-level optimization solved with gradient alignment, with physically feasible constraints from a kinematic bicycle model.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Poison training data with disguised triggersTrajectory prediction models on nuScenes · nuScenes validationtASRHelped
Poison training data with disguised triggersTrajectory prediction models on Argoverse · Argoverse validationtASRHelped
Increase attacking vehicles from one to four (ablation)Backdoor attack on HiVT · Argoverse validationtASR: 91.11 -> 98.02Helped
Increase attacking vehicles from one to four (ablation)Backdoor attack on HiVT · Argoverse validationtCA: 95.30 -> 71.34Hurt
Increase poison rate from 5% to 50% (ablation)Backdoor attack on HiVT · Argoverse validationtASR: 91.1 -> 99.9Helped
Increase poison rate from 5% to 50% (ablation)Backdoor attack on HiVT · Argoverse validationtCA: 95.3 -> 50.0Hurt
Select poison samples by gradient rather than randomly (ablation)Backdoor attack on HiVT · Argoverse validation, 5% poison ratetASR: 86.12 -> 91.11Helped
Limit attacker training-data access to 50% (ablation)Backdoor attack on HiVT · Argoverse validationtASR: 91.11 -> 86.13 (-4.98)Hurt
Limit attacker training-data access to 50% (ablation)Backdoor attack on HiVT · Argoverse validationtCA: 95.30 -> 83.28 (-12.02)Hurt
Use a vector-map surrogate against raster-map victims (ablation)Backdoor attack with PGP surrogate · nuScenestASRHelped
Apply gradient clipping and noise (ablation)Backdoor attack on HiVT · Argoverse validationtASR: 91.11 -> 88.52 (-2.59)Hurt
Apply gradient clipping and noise (ablation)Backdoor attack on MMTrans. · Argoverse validationtASR: 78.55 -> 73.98 (-4.57)Hurt

Surprising findings

Limitations

Experimental setup

Datasets: nuScenes Argoverse

Benchmarks: nuScenes Argoverse

Metrics: ADE FDE tCA tASR

Baselines: clean model (no attack) random sample selection gradient shaping defence

Builds on: gradient alignment for data poisoning point transformation for lane manipulation adversarial trajectory perturbation with kinematic bicycle model

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy