atlas

Research map / Time series / Long-term forecasting

Rethinking the Power of Timestamps for Robust Time Series Forecasting: A Global-Local Fusion Perspective

NeurIPS 2024 · Time series › Long-term forecasting · approach: Attention for time series forecasting · 8 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes GLAFF, a model-agnostic plug-in that models timestamps with an attention mapper, robustly denormalizes them with median/IQR, and adaptively fuses the global mapping with local backbone forecasts.

Problem

Time series forecasting models underuse timestamps as global information and become unreliable when the history window contains anomalies or data drift.

Approach

Model timestamp features alone with a small Transformer encoder to produce a standard-distribution mapping, denormalize it with robust median/quantile statistics computed against history observations, and adaptively weight it against the backbone's local prediction via a softmax MLP over history residuals.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add GLAFF to InformerInformer · All nine datasetsaverage improvement: 23.8%Helped
Add GLAFF to DLinearDLinear · All nine datasetsaverage improvement: 13.1%Helped
Add GLAFF to TimesNetTimesNet · All nine datasetsaverage improvement: 7.5%Helped
Add GLAFF to iTransformeriTransformer · All nine datasetsaverage improvement: 5.5%Helped
Add the backbone's local predictions alongside timestamp-only mapping (ablation)GLAFF + iTransformer · Electricity, Traffic, Weatheraverage MSE: 0.3000 -> 0.2367Helped
Use attention blocks rather than equivalent-size MLP networks (ablation)GLAFF + iTransformer · Electricity, Traffic, Weatheraverage MSE: 0.2646 -> 0.2367Helped
Use robust quantile denormalization rather than conventional inverse normalization (ablation)GLAFF + iTransformer · Electricity, Traffic, Weatheraverage MSE: 0.2555 -> 0.2367Helped
Adaptively combine global mapping and local prediction rather than averaging them (ablation)GLAFF + iTransformer · Electricity, Traffic, Weatheraverage MSE: 0.2591 -> 0.2367Helped

Surprising findings

Limitations

Experimental setup

Datasets: Electricity Exchange Traffic Weather ILI ETTh1 ETTh2 ETTm1 ETTm2

Benchmarks: Electricity Exchange Traffic Weather ILI ETTh1 ETTh2 ETTm1 ETTm2

Metrics: MSE MAE

Baselines: Informer DLinear TimesNet iTransformer FPT

Builds on: iTransformer Informer DLinear TimesNet FPT

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy