Research map / Time series / Causal and generative time series
DiffPTS: Rethinking Diffusion ELBO for Probabilistic Time Series Forecasting
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Rethinks the diffusion ELBO under a location-scale noise model for probabilistic time series forecasting and proposes DiffPTS, which jointly trains mean/variance estimators and the denoiser via the full ELBO.
Problem
Diffusion-based probabilistic time series forecasting methods add pretrained mean and variance estimators to the diffusion process, but train them with ad-hoc regression targets outside the variational (ELBO) framework, leaving reconstruction and prior-matching terms unoptimized.
Approach
Under the location-scale noise model, the full ELBO (reconstruction, prior matching, denoising) induces a Gaussian negative log-likelihood objective for the mean and variance estimators, so they can be trained end-to-end jointly with the denoiser; the ELBO also unifies residual-based and endpoint-based diffusion forecasters (NsDiff, RDIT, D3U, TMDM, DDPM).
Key results
- On ECL, DiffPTS reduces CRPS by 24.8% (0.290 to 0.218) and MSE by 13.9% (0.209 to 0.180) relative to NsDiff.
- On Traffic, DiffPTS reduces CRPS from 0.378 to 0.270 and MSE from 0.637 to 0.456 relative to NsDiff.
- Plug-in DiffPTS improves NsDiff, RDIT and D3U on all four ETT datasets; D3U+DiffPTS on ETTm1 reduces CRPS from 0.412 to 0.290 and MSE from 0.589 to 0.357.
Surprising findings
- The prior-matching and reconstruction terms, usually treated as constants in DDPM, are non-negligible once adaptive estimators are introduced.
- Even the variant trained only on the NLL objective (w/o denoise) remains competitive with the full model on several datasets.
Limitations
- Focuses on the optimization objective and does not study architecture choices for the estimators or the denoiser.
- Does not address faster inference; sampling requires many reverse steps.
- The uncertainty-aware NsDiff noise schedule is not combined with the label-free objective.
Experimental setup
Datasets: ETTh1 ETTh2 ETTm1 ETTm2 Electricity (ECL) Influenza-like Illness (ILI) Exchange Rate (EXR) Traffic Solar Energy
Benchmarks: ETTh1 ETTh2 ETTm1 ETTm2 ECL ILI EXR Traffic Solar
Metrics: CRPS MSE
Baselines: TimeGrad CSDI TimeDiff TMDM DiffusionTS D3U RDIT NsDiff
Builds on: DDPM NsDiff RDIT D3U TMDM
Closest papers by meaning
- Non-stationary Diffusion For Probabilistic Time Series Forecasting (ICML 2025 · similarity 0.93)
- Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamics (NeurIPS 2025 · similarity 0.90)
- Probabilistic Time Series Modeling with Decomposable Denoising Diffusion Model (ICML 2024 · similarity 0.89)
- Auto-Regressive Moving Diffusion Models for Time Series Forecasting (AAAI 2025 · similarity 0.89)
- ANT: Adaptive Noise Schedule for Time Series Diffusion Models (NeurIPS 2024 · similarity 0.89)
- Latent Diffusion Transformer for Probabilistic Time Series Forecasting (AAAI 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
