atlas

Research map / Adversarial robustness and security / Black-box and transfer attacks

SPADE: A Spectral Method for Black-Box Adversarial Robustness Evaluation

ICML 2021 · Adversarial robustness and security › Black-box and transfer attacks · approach: Robustness benchmarks and defenses · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use SPADE-guided variable perturbation sizes instead of random perturbation assignmentPGD adversarial training on MNIST · MNIST, epsilon 0.420PGD-100 accuracy: 83.09 -> 88.46Helped
Use SPADE-guided variable perturbation sizes instead of random perturbation assignmentPGD adversarial training on MNIST · MNIST, epsilon 0.4Clean accuracy: 97.81 -> 97.28Hurt
Use SPADE-guided variable perturbation sizes instead of random perturbation assignmentPGD adversarial training on CIFAR-10 · CIFAR-10, epsilon 2.0/4.0/8.010PGD-50 accuracy: 70.87/65.73/51.77 -> 75.74/69.19/53.61Mixed
Use SPADE-guided variable perturbation sizes instead of vanilla PGDPGD adversarial training on CIFAR-10 · CIFAR-10, epsilon 2.0/4.0/8.010PGD-50 accuracy: 75.28/67.92/50.35 -> 75.74/69.19/53.61Helped
Use SPADE-guided variable perturbation sizes instead of vanilla PGDPGD adversarial training on CIFAR-10 · CIFAR-10Clean accuracy: 81.57 -> 81.38Hurt
Choose edges using the largest edge SPADE scores rather than randomlySPADE edge ranking · MNIST test setAverage DMD (10NN): 3.1/2.6/2.5/2.7 -> 6.6/6.1/6.5/7.7Helped
Choose edges using the largest edge SPADE scores rather than randomlySPADE edge ranking · CIFAR-10 test setAverage DMD (10NN): 6.8/6.4/5.6/5.5/5.3 -> 11.4/11.5/9.7/12.5/8.0Helped
Increase kNN graph k from below 10 to 20 (ablation)SPADE robustness ranking · MNISTCorrect model non-robustness rankingHelped
Vary kNN graph k from 5 to 20 (ablation)SPADE robustness ranking · CIFAR-10Correct model non-robustness rankingNo clear effect
Evaluate CLEVER using SPADE-selected vulnerable samples rather than random samplesCLEVER robustness evaluation · MNIST-2CL, epsilon 0CLEVER score: 162.35/7.592 -> 0.049/0.002Mixed
Use AugMix-trained models instead of standard-trained modelsCIFAR-10 natural robustness evaluation · Clean test setSPADE score: Allconv: 213.03 -> 149.63; Densenet: 152.07 -> 129.49; Resnext: 614.63 -> 571.15; WRN: 784.03 -> 738.35Helped
Use AugMix-trained models instead of standard-trained modelsCIFAR-10 natural robustness evaluation · Corrupted test setSPADE score: Allconv: 39.99 -> 60.68; Densenet: 33.63 -> 53.32; Resnext: 51.57 -> 293.94; WRN: 72.96 -> 100.17Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy