atlas

Research map / Time series / Anomaly detection

SARAD: Spatial Association-Aware Anomaly Detection and Diagnosis for Multivariate Time Series

NeurIPS 2024 · Time series › Anomaly detection · approach: Time series anomaly detection evaluation · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

SARAD trains a Transformer autoencoder on transposed time windows to learn spatial feature associations, then autoencodes the reduction of those associations (progression) to detect and diagnose multivariate time series anomalies.

Problem

Time series anomaly detection and diagnosis in industrial control and service monitoring systems mainly relies on temporal modeling, which overlooks or dilutes spatial (inter-feature) associations that anomalies disrupt.

Approach

Apply an encoder-only Transformer to transposed windows to learn pairwise inter-feature associations; split windows into halves to compute non-negative association decreases (progression) and autoencode these in an MLP, combining data-space and association-space reconstruction errors into a joint anomaly score.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add ReLU to association progression to retain reduction-only changes (ablation)SARAD · SMD, PSM, SWaT, and HAIVUS-ROC: 75.16 -> 79.67; 60.21 -> 61.77; 86.75 -> 87.52; 94.93 -> 96.17Helped
use column-sum instead of row-sum aggregation (ablation)SARAD · SMD, PSM, SWaT, and HAIVUS-ROC: 79.17 -> 79.67; 63.20 -> 61.77; 87.40 -> 87.52; 95.80 -> 96.17Mixed
sum progression values during aggregation rather than concatenate them (ablation)SARAD · SMD, PSM, SWaT, and HAIVUS-ROC: 56.98 -> 79.67; 47.34 -> 61.77; 85.26 -> 87.52; 90.70 -> 96.17Helped
reconstruct progression instead of using progression directly as the anomaly criterion (ablation)SARAD · PSM, SWaT, and HAIVUS-ROC: 60.49 -> 61.77; 86.70 -> 87.52; 94.98 -> 96.17Helped
combine data reconstruction and progression reconstruction errors instead of using data error only (ablation)SARAD · SMD, PSM, SWaT, and HAIVUS-ROC: 72.72 -> 79.67; 61.45 -> 61.77; 86.15 -> 87.52; 95.56 -> 96.17Mixed
combine data and progression reconstruction errors instead of using progression error only (ablation)SARAD · SMD, PSM, SWaT, and HAIVUS-ROC: 79.39 -> 79.67; 62.20 -> 61.77; 65.31 -> 87.52; 94.77 -> 96.17Mixed

Surprising findings

Limitations

Experimental setup

Datasets: SMD PSM SWaT HAI

Benchmarks: SMD PSM SWaT HAI

Metrics: AUC-ROC AUC-PR VUS-ROC VUS-PR HR@P% NDCG@P% IPS@P% Precision Recall F1

Baselines: IF DIF TranAD ATF-UAD AT DCdetector USAD GDN MAD-GAN DiffAD

Builds on: Transformer iTransformer USAD Isolation Forest

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy