atlas

Research map / Architectures and efficiency / Attention and transformers

MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection

NeurIPS 2024 · Architectures and efficiency › Attention and transformers · approach: Mamba architectures · 69 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Applies Mamba-based state space decoder (MambaAD: pretrained encoder plus LSS modules with HSS multi-directional scanning) to multi-class unsupervised anomaly detection, reporting SoTA on six datasets.

Problem

Multi-class unsupervised anomaly detection suffers from CNNs' weak long-range modeling and transformers' quadratic cost, limiting reconstruction-based methods like UniAD to the smallest feature maps.

Approach

A pyramid auto-encoder with a pretrained encoder and a Mamba decoder whose Locality-Enhanced State Space (LSS) modules combine cascaded Hybrid State Space (HSS) blocks (five scanning methods, eight directions, including Hilbert scan) with parallel multi-kernel convolutions, computing multi-scale anomaly maps.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use MambaAD instead of DiADmulti-class anomaly detection · MVTec-AD image-levelAU-ROC: 97.2 -> 98.6Helped
Use MambaAD instead of DiADmulti-class anomaly detection · MVTec-AD image-levelAP: 99.0 -> 99.6Helped
Use MambaAD instead of DiADmulti-class anomaly detection · MVTec-AD image-levelF1_max: 96.5 -> 97.8Helped
Use MambaAD instead of SimpleNetmulti-class anomaly localization · MVTec-AD pixel-levelAU-ROC: 96.9 -> 97.7Helped
Use MambaAD instead of DeSTSegmulti-class anomaly localization · MVTec-AD pixel-levelAP: 54.3 -> 56.3Helped
Use MambaAD instead of DiADmulti-class anomaly localization · MVTec-AD pixel-levelF1_max: 55.5 -> 59.2Helped
Use MambaAD instead of RD4ADmulti-class anomaly localization · MVTec-AD pixel-levelAU-PRO: 91.1 -> 93.1Helped
Use MambaAD instead of RD4ADmulti-class anomaly detection · VisA image-levelAU-ROC: 92.4 -> 94.3Helped
Use MambaAD instead of RD4ADmulti-class anomaly detection · VisA image-levelAP: 92.4 -> 94.5Helped
Use MambaAD instead of RD4ADmulti-class anomaly detection · VisA image-levelF1_max: 89.6 -> 89.4Hurt
Use MambaAD instead of RD4ADmulti-class anomaly localization · VisA pixel-levelAU-ROC: 98.1 -> 98.5Helped
Use MambaAD instead of DeSTSegmulti-class anomaly localization · VisA pixel-levelAP: 39.6 -> 39.4Hurt

Limitations

Experimental setup

Datasets: MVTec-AD VisA MVTec-3D Uni-Medical COCO-AD Real-IAD

Benchmarks: MVTec-AD VisA MVTec-3D Uni-Medical COCO-AD Real-IAD

Metrics: AU-ROC AP F1_max AU-PRO

Baselines: RD4AD UniAD SimpleNet DeSTSeg DiAD ViTAD

Builds on: Mamba VMamba RD4AD UniAD Hilbert curve scanning

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy