Research map / Label-efficient and robust learning / OOD and anomaly detection
ProHOC: Probabilistic Hierarchical Out-of-Distribution Classification via Multi-Depth Networks
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes ProHOC, which classifies in-distribution and OOD samples to nodes of a class hierarchy by factorizing a probabilistic tree model over networks trained at each hierarchy depth.
Problem
Standard OOD detection is binary and ignores semantic relations between OOD samples and ID classes; the goal is to assign OOD samples to their correct internal nodes of a known class hierarchy.
Approach
Factorize the predictive distribution over a hierarchy with an OOD child node at each internal node, and approximate the conditionals with separately trained multi-depth classifiers using complementary probability plus child-prediction entropy as the OOD score; predictions minimize expected hierarchical distance.
Key results
- ProHOC with EntCompProb reaches MixBAcc 50.3 on FGVC-Aircraft vs 46.1 for HSC, and 46.4 vs 42.3 on SimpleHierImageNet.
- On iNaturalist19, ProHOC (EntCompProb) attains MixBMHD 0.94 vs 1.28 for HSC.
- Multi-depth networks beat marginalized leaf predictions on OOD samples at ground-truth depth by +1.6 to +17.0 accuracy points.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use ProHOC (EntCompProb) instead of HSC | Hierarchical OOD classification · SimpleHierImageNet | MixBAcc: 42.3 -> 46.4 | Helped |
| Use ProHOC (EntCompProb) instead of HSC | Hierarchical OOD classification · SimpleHierImageNet | MixBMHD: 1.28 -> 1.21 | Helped |
| Use ProHOC (EntCompProb) instead of HSC | Hierarchical OOD classification · iNaturalist19 | MixBAcc: 38.2 -> 46.7 | Helped |
| Use ProHOC (EntCompProb) instead of HSC | Hierarchical OOD classification · iNaturalist19 | MixBMHD: 1.28 -> 0.94 | Helped |
| Use ProHOC (EntCompProb) instead of HSC | Hierarchical OOD classification · FGVC-Aircraft | MixBAcc: 46.1 -> 50.3 | Helped |
| Use ProHOC (EntCompProb) instead of HSC | Hierarchical OOD classification · FGVC-Aircraft | MixBMHD: 0.94 -> 0.81 | Helped |
| Use argmax p(c|x) instead of minimizing expected hierarchical distance (ablation) | ProHOC (EntCompProb) · SimpleHierImageNet | MixBMHD: 1.21 -> 1.25 | Hurt |
| Use argmax p(c|x) instead of minimizing expected hierarchical distance (ablation) | ProHOC (EntCompProb) · SimpleHierImageNet | MixBAcc: 46.4 -> 45.8 | Hurt |
| Use argmax p(c|x) instead of minimizing expected hierarchical distance (ablation) | ProHOC (EntCompProb) · iNaturalist19 | MixBMHD: 0.94 -> 0.98 | Hurt |
| Use argmax p(c|x) instead of minimizing expected hierarchical distance (ablation) | ProHOC (EntCompProb) · iNaturalist19 | MixBAcc: 46.7 -> 45.6 | Hurt |
| Use argmax p(c|x) instead of minimizing expected hierarchical distance (ablation) | ProHOC (EntCompProb) · FGVC-Aircraft | MixBMHD: 0.81 -> 0.88 | Hurt |
| Use argmax p(c|x) instead of minimizing expected hierarchical distance (ablation) | ProHOC (EntCompProb) · FGVC-Aircraft | MixBAcc: 50.3 -> 50.2 | Hurt |
Surprising findings
- The HSC baseline was given thresholds tuned on test OOD data, yet ProHOC still outperforms it.
Limitations
- Performance is bounded by the underlying multi-depth networks, which were not optimized (ResNet50, standard training).
- Assumes the class hierarchy reflects observable visual similarity; fails when ID and OOD siblings share no visual features.
Experimental setup
Datasets: FGVC-Aircraft iNaturalist19 SimpleHierImageNet tieredImageNet
Benchmarks: FGVC-Aircraft iNaturalist19 SimpleHierImageNet Office31 PACS
Metrics: BMHD MixBMHD balanced accuracy MixBAcc F1 Dirty F1 accuracy on out-of-hierarchy OOD
Baselines: Depth oracle Leaf model HSC
Builds on: HSC hierarchical OOD classification maximum softmax probability OOD detection entropy-based OOD scoring
Closest papers by meaning
- CASE: Exploiting Intra-class Compactness and Inter-class Separability of Feature Embeddings for Out-of-Distribution Detection (AAAI 2024 · similarity 0.88)
- Out-of-Distribution Detection with Prototypical Outlier Proxy (AAAI 2025 · similarity 0.87)
- Splitting & Integrating: Out-of-Distribution Detection via Adversarial Gradient Attribution (ICML 2025 · similarity 0.87)
- CADRef: Robust Out-of-Distribution Detection via Class-Aware Decoupled Relative Feature Leveraging (CVPR 2025 · similarity 0.87)
- Mysteries of the Deep: Role of Intermediate Representations in Out of Distribution Detection (NeurIPS 2025 · similarity 0.87)
- Exploiting Discrepancy in Feature Statistic for Out-of-Distribution Detection (AAAI 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
