atlas

Research map / Time series / Long-term forecasting

Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series

NeurIPS 2024 · Time series › Long-term forecasting · approach: Transformers for long-term forecasting · 6 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Transforms time series into images (delay embedding or STFT) and trains an EDM diffusion model on them, enabling unconditional, interpolation and extrapolation generation across short to ultra-long sequences.

Problem

Generative modeling of time series spans short multivariate sequences and long or ultra-long univariate sequences, but existing methods typically handle only one regime, due to RNN gradient issues, transformer quadratic cost, and limited SSM expressivity.

Approach

Map time series to small images with invertible transforms (delay embedding, STFT) and apply a vision diffusion backbone (EDM), so one framework scales from length 24 to about 17.5k without architectural changes.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use ImagenTime instead of the strongest listed baselineShort-term unconditional generation · MuJoCodisc: .059 ± .009 -> .007 ± .005Helped
Use ImagenTime instead of the strongest listed baselineLong-term unconditional generation · FRED-MDpred: .037 -> .009Helped
Use ImagenTime instead of LS4Long-term unconditional generation · NN5 Dailypred: .241 -> .393Hurt
Use ImagenTime instead of LS4Long-term unconditional generation · Temp Rainmarg: .083 -> .409Hurt
Use ImagenTime instead of LS4Ultra-long unconditional generation · KDD-Cuppred: .049 -> .001Helped
Use delay embedding rather than folding (ablation)ImagenTime · FRED-MDmarg: .012 -> .017Hurt
Use STFT rather than delay embedding (ablation)ImagenTime · FRED-MDpred: .021 -> .009Helped
Use delay embedding rather than STFT (ablation)ImagenTime · Energydisc: .271 -> .040Helped
Use GAF rather than delay embedding (ablation)ImagenTime · Energydisc: .040 -> .349Hurt

Surprising findings

Limitations

Experimental setup

Datasets: Stocks Energy MuJoCo Sine FRED-MD NN5 Daily Temp Rain Traffic KDD-Cup ETTh1 ETTh2 ETTm1

Benchmarks: Stocks Energy MuJoCo FRED-MD NN5 Daily Temp Rain Traffic KDD-Cup ETTh1 ETTh2 ETTm1 ETTm2

Metrics: discriminative score predictive score marginal score classification score MSE Wasserstein distance

Baselines: KoVAE DiffTime GT-GAN TimeGAN RCGAN C-RNN-GAN T-Forcing P-Forcing WaveNet WaveGAN LS4 SaShiMi

Builds on: EDM LS4 delay embedding short-time Fourier transform

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy