atlas

Research map / Adversarial robustness and security / Certified and empirical robustness

Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attack

ICML 2022 · Adversarial robustness and security › Certified and empirical robustness · approach: Attack evaluation and defense critique · 5 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the minimum-margin loss with natural logits instead of CW lossMM attack · CIFAR-10, CIFAR-100, SVHN, Tiny-Imagenetattack success rate (%): 49.13 -> 51.36; 74.55 -> 76.52; 45.08 -> 47.56; 81.19 -> 82.97Helped
Use natural logits without rescaling rather than Targeted-DLR rescaling (ablation)MM attack · CIFAR-10successful attack set size: 5078 -> 5219Helped
Use minimum-margin attack instead of PGDAdversarial robustness evaluation · CIFAR-10attack success rate (%): 48.27 -> 51.36Helped
Select 3 targets with STARS rather than attack all false targets (ablation)MM attack · CIFAR-10, CIFAR-100, SVHNcomputational time: 76.36%; 98.51%; 77.78% time savedHelped
Preselect 3 targets rather than all targets (ablation)MM attack · CIFAR-10, CIFAR-100, SVHNreliability: 99.13%; 99.49%; 98.78%Mixed
Increase target selection from 3 to 5 (ablation)MM attack · CIFAR-10, CIFAR-100, SVHNreliability: 99.13% -> 99.78%; 99.49% -> 99.82%; 98.78% -> 99.67%Helped
Increase target selection from 3 to 5 (ablation)MM attack · CIFAR-10, CIFAR-100, SVHNcomputational time: 33.58% -> 55.72%; 3.11% -> 5.07%; 33.33% -> 55.49% of all-target timeHurt
Use 9 targets and 100 steps (MM+) instead of 3 targets and 20 steps (MM3) (ablation)MM attack · CIFAR-10test accuracy (%): 46.69 -> 46.11Helped
Use 9 targets and 100 steps (MM+) instead of 3 targets and 20 steps (MM3) (ablation)MM attack · CIFAR-10computational time (s): 126 -> 1421Hurt
Rank targets using adversarial inputs instead of natural inputs (ablation)STARS · CIFAR-10, SVHN, CIFAR-100test accuracy (%): CIFAR-10: 48.23 -> 47.92; SVHN: 52.45 -> 51.97; CIFAR-100: 23.92 -> 23.57No clear effect
Replace PGD-generated training adversarial examples with MM-generated examplesAdversarial training · CIFAR-10robust test accuracy (%): 46.43 -> 47.86Helped
Use adaptive MM3 steps instead of MM3-F10 fixed steps (ablation)MM adversarial training · CIFAR-10test accuracy (%) under AA: 47.62 -> 48.28Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy