atlas

Research map / Time series / Long-term forecasting

DDN: Dual-domain Dynamic Normalization for Non-stationary Time Series Forecasting

NeurIPS 2024 · Time series › Long-term forecasting · approach: Attention for time series forecasting · 31 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes DDN, a model-agnostic plug-in that performs sliding-window normalization in both wavelet frequency and time domains and reconstructs non-stationary statistics via a distribution prediction model for time series forecasting.

Problem

DNN-based time series forecasters give unreliable predictions on non-stationary data whose distribution drifts over time; existing normalization methods use fixed windows or slices and struggle to capture rapid, time-varying distribution changes.

Approach

Combine point-level sliding-window normalization in the time domain with sliding normalization of DWT low- and high-frequency components (learnable wavelet bases), weight the two stationary outputs, and reconstruct future mean/std via a distribution prediction model trained with pretraining then collaborative training.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add DDN normalizationAutoformer · Weather, Electricity, Traffic (96-step forecast)MSE: 0.247 -> 0.190; 0.195 -> 0.150; 0.654 -> 0.453Helped
Add DDN normalizationFEDformer · Weather, Electricity, Traffic (96-step forecast)MSE: 0.246 -> 0.174; 0.185 -> 0.146; 0.579 -> 0.442Helped
Add DDN normalizationDLinear · Weather, Electricity, Traffic (96-step forecast)MSE: 0.175 -> 0.146; 0.140 -> 0.131; 0.411 -> 0.375Helped
Replace RevIN with DDNiTransformer · Weather, Electricity, Traffic (96-step forecast)MSE: 0.177 -> 0.148; 0.133 -> 0.127; 0.348 -> 0.336Helped
Add time-domain normalization (TDN) alongside frequency-domain normalization (FDN) (ablation)DLinear + FDN Only · WeatherMSE: 0.149 -> 0.146Helped
Add frequency-domain normalization (FDN) alongside time-domain normalization (TDN) (ablation)DLinear + TDN Only · WeatherMSE: 0.150 -> 0.146Helped
Add time-domain normalization (TDN) alongside frequency-domain normalization (FDN) (ablation)DLinear + FDN Only · ElectricityMSE: 0.132 -> 0.131Helped
Add frequency-domain normalization (FDN) alongside time-domain normalization (TDN) (ablation)DLinear + TDN Only · ElectricityMSE: 0.133 -> 0.131Helped
Add time-domain normalization (TDN) alongside frequency-domain normalization (FDN) (ablation)DLinear + FDN Only · TrafficMSE: 0.375 -> 0.375No clear effect
Add frequency-domain normalization (FDN) alongside time-domain normalization (TDN) (ablation)DLinear + TDN Only · TrafficMSE: 0.378 -> 0.375Helped
Add time-domain normalization (TDN) alongside frequency-domain normalization (FDN) (ablation)iTransformer + FDN Only · ElectricityMSE: 0.126 -> 0.127Hurt
Add both time- and frequency-domain normalization (ablation)DLinear · Weather, Electricity, TrafficMSE: Table 5Mixed

Surprising findings

Limitations

Experimental setup

Datasets: ETTh1 ETTh2 ETTm1 ETTm2 Weather Electricity Traffic

Benchmarks: ETTh1 ETTh2 ETTm1 ETTm2 Weather Electricity Traffic

Metrics: MSE MAE

Baselines: RevIN NST Dish-TS SAN Autoformer FEDformer DLinear iTransformer

Builds on: RevIN SAN Dish-TS Non-stationary Transformers iTransformer

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy