atlas

Research map / Label-efficient and robust learning / OOD and anomaly detection

Vague Prototype-Oriented Diffusion Model for Multi-Class Anomaly Detection

ICML 2024 · Label-efficient and robust learning › OOD and anomaly detection · approach: Deep one-class and tabular anomaly detection

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes VPDM, a conditional diffusion model for multi-class unsupervised anomaly detection that conditions on learned vague prototypes (low-pass features matched via optimal transport) to avoid the identical shortcut problem.

Problem

Multi-class unsupervised anomaly detection with reconstruction models suffers from the "identical shortcut" problem, where anomalous information in the condition lets the model reconstruct anomalies.

Approach

Use low-pass-filtered features matched via entropic optimal transport to a set of learnable vague prototypes as the diffusion condition, and build a diffusion process that starts from N(ŷ, I) and incrementally adds details, so anomalous detail is excluded at the input.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use VPDM instead of HVQ-TransMVTec-AD multi-class anomaly detection · MVTec-ADimage-level AUROC: 98.0 -> 98.4±0.04Helped
use VPDM instead of HVQ-TransMVTec-AD anomaly localization · MVTec-ADpixel-wise AUROC: 97.3 -> 97.8±0.02Helped
use VPDM instead of HVQ-TransVisA multi-class anomaly detection · VisAimage-level AUROC: 93.2 -> 94.2±0.09Helped
use VPDM instead of HVQ-TransVisA anomaly localization · VisApixel-wise AUROC: 98.7 -> 98.9±0.02Helped
add OT prototype matching (ablation)Vague-only model on MVTec-AD · MVTec-ADimage-level AUROC: 68.4 -> 93.5Helped
add OT prototype matching (ablation)Vague-only model on MVTec-AD · MVTec-ADpixel-wise AUROC: 68.8 -> 94.1Helped
add the OT loss (ablation)Vague + OT model on MVTec-AD · MVTec-ADimage-level AUROC: 93.5 -> 97.1Helped
add the OT loss (ablation)Vague + OT model on MVTec-AD · MVTec-ADpixel-wise AUROC: 94.1 -> 96.9Helped
replace VPDM's proposed diffusion process with standard N(0, I) initialization (ablation)VPDM on MVTec-AD · MVTec-ADimage-level AUROC: 98.4 -> 76.7Hurt
replace VPDM's proposed diffusion process with standard N(0, I) initialization (ablation)VPDM on MVTec-AD · MVTec-ADpixel-wise AUROC: 97.8 -> 80.1Hurt
remove vague filtering (ablation)VPDM on MVTec-AD · MVTec-ADimage-level AUROC: 98.4 -> 96.5Hurt
remove vague filtering (ablation)VPDM on MVTec-AD · MVTec-ADpixel-wise AUROC: 97.8 -> 96.8Hurt

Surprising findings

Limitations

Experimental setup

Datasets: MVTec-AD VisA MPDD

Benchmarks: MVTec-AD VisA MPDD

Metrics: AUROC

Baselines: UniAD DiAD HVQ-Trans DRAEM RD4AD PaDiM MKD PSVDD US JNLD OmniAL

Builds on: DDPM Sinkhorn optimal transport DiAD HVQ-Trans

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy