atlas

Research map / Label-efficient and robust learning / OOD and anomaly detection

Long-Tailed Anomaly Detection with Learnable Class Names

CVPR 2024 · Label-efficient and robust learning › OOD and anomaly detection · approach: Unified multi-class anomaly detection · 15 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Formulates long-tailed unsupervised anomaly detection with resampled MVTec, VisA and DAGM splits and proposes LTAD, which combines reconstruction-based and semantic AD using learned pseudo class names and a VAE for feature augmentation.

Problem

Unsupervised anomaly detection and localization across many object classes without class-name priors, when training data follows long-tailed class distributions and no defect images are available.

Approach

Combines transformer-based feature reconstruction with a semantic normal/abnormal classifier in ALIGN text space, where class names are replaced by learned pseudo class-name prompts, and uses a text-conditioned VAE to synthesize tail-class features for augmentation.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add the semantic AD module to LTAD (ablation)LTAD · MVTec step100detection AUROC: 87.05 -> 87.36Helped
Add the semantic AD module to LTAD (ablation)LTAD · MVTec step100segmentation AUROC: 93.13 -> 93.83Helped
Replace the text-conditioned VAE with an autoencoder (ablation)LTAD without SAD on MVTec step100 · MVTec step100detection AUROC: 87.05 -> 84.48Hurt
Replace the text-conditioned VAE with an autoencoder (ablation)LTAD without SAD on MVTec step100 · MVTec step100segmentation AUROC: 93.13 -> 92.53Hurt
Use distribution-aware sampling instead of pc = 0.5 (ablation)LTAD without SAD on MVTec step100 · MVTec step100detection AUROC: 87.05 -> 86.06Hurt
Initialize learned pseudo class names with dataset class names (ablation)LTAD without SAD on MVTec step100 · MVTec step100detection AUROC: 87.05 -> 86.12Hurt
Add layer-aware projection (ablation)LTAD semantic AD module without RM on MVTec step100 · MVTec step100segmentation AUROC: 87.18 -> 91.36Helped
Use max pooling instead of mean pooling across projected layers (ablation)LTAD semantic AD module without RM on MVTec step100 · MVTec step100detection AUROC: 81.25 -> 84.12Helped
Use multiple normal/abnormal text prompts instead of a single prompt (ablation)LTAD semantic AD module without RM on MVTec step100 · MVTec step100detection AUROC: 84.12 -> 77.19Hurt
Use the ALIGN text encoder and its class prior (ablation)LTAD semantic AD module on MVTec step100 · MVTec step100detection AUROC: 59.79 -> 84.12Helped
Keep each learned pseudo class name assigned to its corresponding class (ablation)LTAD semantic AD module on MVTec step100 · MVTec step100detection AUROC: 72.76 -> 84.12Helped
Use normal prompt “a” and abnormal prompt “a broken” (ablation)LTAD semantic AD module · MVTec step100detection AUROC: 84.12 / 91.36Helped

Surprising findings

Limitations

Experimental setup

Datasets: MVTec VisA DAGM

Benchmarks: MVTec VisA DAGM

Metrics: AUROC (image) AUROC (pixel) average/High/Low AUROC

Baselines: Cut & Paste MKD DRAEM RegAD UniAD AnomalyGPT

Builds on: UniAD ALIGN WinCLIP RegAD CoOp

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy