Research map / Time series / Anomaly detection
Towards a General Time Series Anomaly Detector with Adaptive Bottlenecks and Dual Adversarial Decoders
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Pre-trains a general time series anomaly detector (DADA) on multi-domain data with adaptive bottleneck selection and dual adversarial decoders, evaluated zero-shot on downstream anomaly detection benchmarks.
Problem
Time series anomaly detection models are trained per dataset and generalize poorly across domains; a single general model must handle varying information-bottleneck needs and distinguish normal from diverse anomalies without target-domain training.
Approach
Combines a pool of different-sized bottlenecks chosen per series by a noisy top-k adaptive router with dual decoders: a normal decoder for normal reconstruction and an anomaly decoder trained adversarially (via gradient reversal) on injected anomalies, with complementary-mask reconstruction and variance-based anomaly scores.
Key results
- Zero-shot DADA achieves affiliated F1 of 84.57 on SMD, 78.48 on MSL, 75.42 on SMAP, 74.60 on SWaT, 82.26 on PSM, best among listed baselines trained per dataset.
- On NeurIPS-TS, DADA reports best F1 on CICIDS (73.49), Creditcard (75.12), and SWAN (71.93) and second on GECCO (90.20 F1 vs D3R 91.83).
- Ablation: removing AdaBN drops average F1 from 79.49 to 74.45; removing adversarial training and dual decoders drops to 63.23 average F1.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add adaptive bottlenecks instead of using one fixed bottleneck (ablation) | DADA · SMD/MSL/SMAP (zero-shot) | Avg F1: 74.45 -> 79.49 | Helped |
| add adversarial training (ablation) | DADA · SMD/MSL/SMAP (zero-shot) | Avg F1: 63.23 -> 79.49 | Helped |
| use dual decoders rather than a single decoder (ablation) | DADA · SMD/MSL/SMAP (zero-shot) | Avg F1: 74.76 -> 79.49 | Helped |
| remove adversarial training and use a single decoder (ablation) | DADA · SMD/MSL/SMAP (zero-shot) | Avg F1: 77.81 -> 79.49 | Hurt |
| replace adaptive bottlenecks with same-size 256 bottlenecks (ablation) | DADA · SWaT/GECCO/Creditcard | F1: 74.60 vs 71.68; 90.20 vs 87.81; 75.12 vs 71.36 | Hurt |
| replace complementary masking with ordinary masking (ablation) | DADA · SMD/MSL/SMAP/SWaT/PSM | F1: 84.25 vs 84.57; 78.51 vs 78.48; 75.03 vs 75.42; 74.32 vs 74.60; 81.87 vs 82.26 | Mixed |
| set the complementary mask ratio to 0.5 / 0.5 rather than the lower tested ratios (ablation) | DADA · SMD/SMAP/MSL/SWaT/PSM | Avg F1: 74.00; 75.32; 77.64; 78.98 | Helped |
| pre-train without human-labeled data, using anomaly injection (ablation) | DADA · SMD/MSL/SMAP/SWaT/PSM | F1: 84.57 vs 84.69; 78.48 vs 78.05; 75.42 vs 75.35; 74.60 vs 74.07; 82.26 vs 82.39 | No clear effect |
| fine-tune on downstream data after pre-training | DADA · MSL and SMD | F1: 78.48% to 79.90%; 84.57% to 85.50% | Helped |
| use DADA rather than the strongest reported baseline | DADA (zero shot) · SMD/MSL/SMAP/SWaT/PSM | F1: 83.16 -> 84.57; 77.23 -> 78.48; 74.67 -> 75.42; 74.41 -> 74.60; 81.44 -> 82.26 | Helped |
| use DADA rather than the strongest reported baseline | DADA (zero shot) · CICIDS/Creditcard/GECCO/SWAN | F1: 67.79 -> 73.49; 73.80 -> 75.12; 91.83 -> 90.20; 47.27 -> 71.93 | Mixed |
Surprising findings
- Training without any human labels (anomaly injection only) yields nearly identical F1 (e.g., 84.69 vs 84.57 on SMD).
- Replacing adaptive bottlenecks with a mixture-of-experts of same-size bottlenecks (MoE 256) underperforms AdaBN on several datasets such as SWaT, GECCO, and Creditcard.
Limitations
- Evaluation relies on affiliated F1 and AUC; PA-based comparisons with baselines are not directly reported in the main text.
- Anomaly injection defines the anomaly types used in adversarial training, so unseen anomaly types may be missed unless added to pre-training, as the authors note.
Experimental setup
Datasets: Monash ASD Exathlon ECG MITDB OPP SVDB GAIA IOPS MGAB NYC SKAB
Benchmarks: SMD MSL SMAP SWaT PSM NeurIPS-TS (CICIDS, Creditcard, GECCO, SWAN) UCR
Metrics: affiliated F1 affiliated precision affiliated recall AUC_ROC VUS F1
Baselines: OCSVM PCA IForest LODA AutoEncoder DAGMM BeatGAN OmniAnomaly Anomaly Transformer MEMTO DCdetector D3R
Builds on: GPT4TS Anomaly Transformer gradient reversal layer SPOT
Closest papers by meaning
- The Elephant in the Room: Towards A Reliable Time-Series Anomaly Detection Benchmark (NeurIPS 2024 · similarity 0.89)
- Fortifying Time Series: DTW-Certified Robust Anomaly Detection (NeurIPS 2025 · similarity 0.87)
- Position: Quo Vadis, Unsupervised Time Series Anomaly Detection? (ICML 2024 · similarity 0.87)
- Graph Mixture of Experts and Memory-augmented Routers for Multivariate Time Series Anomaly Detection (AAAI 2025 · similarity 0.86)
- Retrieval Over Training: Similarity search-based Model Selection for Time Series Anomaly Detection (NeurIPS 2026 · similarity 0.86)
- Structured Temporal Causality for Interpretable Multivariate Time Series Anomaly Detection (NeurIPS 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
