AI Paper Atlas

Research map / Adversarial robustness and security / Black-box and transfer attacks

Towards Evaluating Transfer-based Attacks Systematically, Practically, and Fairly

Qizhang Li, Yiwen Guo, Wangmeng Zuo, Hao Chen

NeurIPS 2023 · Adversarial robustness and security › Black-box and transfer attacks · approach: Transferable adversarial examples · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
apply victim test-time pre-processing (resize+crop) when evaluatingI-FGSM adversarial examples · ImageNetavg victim accuracy: 86.16% -> 87.79%Hurt
use UN-DP-DI2-TI-PI-FGSM back-end instead of I-FGSMResNet/transformer substitutes · ImageNet l_infAAA: 91.58% -> 42.42%Improved
add SI-FGSM to UN-DP-DI2-TI-PI-FGSM (ablation)input augmentation back-end · ImageNetAAA: 42.42% -> 43.12%Hurt
add Admix to UN-DP-DI2-TI-PI-FGSM (ablation)input augmentation back-end · ImageNetAAA: 42.42% -> 44.11%Hurt
swap PI-FGSM for NI-FGSM or MI-FGSM (ablation)UN-DP-DI2-TI back-end · ImageNetAAA: 42.42% -> 42.45%No clear effect
replace I-FGSM with PGD (ablation)optimizer · ImageNetAAANo clear effect
combine SGM with new back-endSGM, ResNet-50 substitute · ImageNetAA: 72.56% -> 31.97%Improved
switch substitute from ResNet-50 to ViT-BSGM · ImageNetAA: 31.97% -> 28.80%Improved
switch substitute from ResNet-50 to ViT-BSGM · ImageNetWAA: 48.32% -> 37.24%Improved
add new back-end to NAANAA · ImageNetAAA: 72.65% -> 42.60%Mixed
add new back-end to LinBP, ConvNeXt-B substituteLinBP · ImageNetAA: 89.05% -> 18.81%Improved
compare MoreBayesian against other substitute-training methods with new back-endMoreBayesian, ResNet-50 · ImageNetAA: 27.09%Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy