Research map / Label-efficient and robust learning / OOD and anomaly detection
Leveraging Perturbation Robustness to Enhance Out-of-Distribution Detection
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes Perturbation Rectified OOD (PRO), a post-hoc method that runs multi-step gradient descent on the input to minimize softmax-based OOD scores, exploiting that OOD confidence drops more under perturbation, and pairs it with adversarially robust models for improved near-OOD detection.
Problem
Out-of-distribution detection for image classifiers, especially the harder near-OOD setting, where softmax-based scores often assign high confidence to OOD inputs.
Approach
An adversarial score function g*(x) = min over bounded perturbations of g(x+δ), computed by sign-gradient descent with minimum taken over intermediate iterates, so that OOD scores drop more than IND scores; adversarially trained models make IND scores more stable, further separating the two.
Key results
- On a CIFAR-10 model with adversarial training (LRR), PRO-MSP-T reduces near-OOD average FPR@95 to 19.95 versus 32.85 for MSP, and beats the best prior baseline by more than 10 points.
- PRO variants achieve the best near-OOD FPR@95 and AUROC on CIFAR-10 default and robust models, and are competitive on CIFAR-100 near-OOD.
- On ImageNet-1K, PRO gives little benefit for far-OOD and its gains diminish as model scale and class count grow, with activation-based methods (Scale, ASH, ReAct) performing best there.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Apply PRO-GEN instead of GEN | CIFAR-10 IND model (LRR) · CIFAR-100 | FPR@95: 60.02 -> 37.38 | Helped |
| Apply PRO-GEN instead of GEN | CIFAR-10 IND model (LRR) · CIFAR-100 | AUROC: 88.80 -> 89.50 | Helped |
| Apply PRO-GEN instead of GEN | CIFAR-10 IND model (LRR) · TIN | FPR@95: 46.17 -> 30.37 | Helped |
| Apply PRO-GEN instead of GEN | CIFAR-10 IND model (LRR) · TIN | AUROC: 91.45 -> 91.90 | Helped |
| Use PRO on softmax scores | CIFAR-100 IND model (LRR-CARD-Deck) · Near-OOD | AUROC: 81.88 -> 82.50 | Helped |
| Use PRO on softmax scores | CIFAR-100 IND model (LRR-CARD-Deck) · Far-OOD | AUROC: 79.16 -> 78.42 | Hurt |
| Use adversarially robust LRR model instead of default model | PRO methods · CIFAR-10 IND, average OOD sets | AUROC: 91.79 -> 95.00 | Helped |
| Use PRO on softmax scores | ImageNet-1K models · Near-OOD | AUROC | Helped |
| Use PRO on softmax scores | ImageNet-1K models · Far-OOD | AUROC | No clear effect |
| Use NoisyMix or SIN-IN robust models | ImageNet-1K softmax scores · Near-OOD | OOD detection performance | Hurt |
Surprising findings
- ODIN, which also uses gradient-based input perturbation, degrades MSP performance on CIFAR-10 and near-OOD settings, whereas PRO's minimization direction helps.
- PRO benefits even standard models without adversarial training, because standard training already yields smoother IND score landscapes.
Limitations
- PRO's gains shrink as model scale and class count increase (e.g., ImageNet-1K), since IND scores become more perturbation-sensitive.
- Requires per-benchmark search over perturbation size and step number on a validation set; the paper uses OOD-specific hyperparameter selection.
- Gains on far-OOD and ImageNet are limited; the approach is best suited to small-scale models.
Experimental setup
Datasets: CIFAR-10 CIFAR-100 ImageNet-1K
Benchmarks: OpenOOD RobustBench CIFAR-100 TIN MNIST SVHN Texture Places365
Metrics: AUROC FPR@95
Baselines: MSP ODIN MDS GEN EBO VIM KNN ASH Scale GradNorm ReAct MLS
Builds on: ODIN Maximum Softmax Probability GEN OpenOOD RobustBench
Closest papers by meaning
- Splitting & Integrating: Out-of-Distribution Detection via Adversarial Gradient Attribution (ICML 2025 · similarity 0.91)
- Enhancing the Power of OOD Detection via Sample-Aware Model Selection (CVPR 2024 · similarity 0.89)
- Revisiting Logit Distributions for Reliable Out-of-Distribution Detection (NeurIPS 2025 · similarity 0.89)
- CADRef: Robust Out-of-Distribution Detection via Class-Aware Decoupled Relative Feature Leveraging (CVPR 2025 · similarity 0.89)
- The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection (NeurIPS 2024 · similarity 0.89)
- SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation (NeurIPS 2024 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
