Research map / Time series / Causal and generative time series
Conditional Diffusion Model with Nonlinear Data Transformation for Time Series Forecasting
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes CN-Diff, a conditional diffusion model for time series forecasting that adds a learnable nonlinear time-dependent data transformation and a learnable condition to the forward process, trained with a non-Markovian variational bound.
Problem
Standard conditional diffusion models for time series use a fixed linear Gaussian forward process and an isotropic Gaussian prior, which limits their ability to capture complex temporal patterns and widens the gap between the NLL and its variational bound.
Approach
Make the forward process learnable by applying a nonlinear time-dependent transformation T_phi to the data and a learnable condition c, so the prior becomes N(c, I) and the reverse process is non-Markovian; derive a new variational loss with prior, reconstruction, and diffusion terms.
Key results
- Multivariate average rank of 1.7 across nine datasets, with best MSE on 6 of 9 (e.g., NorPool 0.531 vs mr-Diff 0.645; ETTh1 0.405).
- Univariate average rank 2.0, best on four of nine datasets (e.g., ETTh1 0.066, ETTm1 0.038).
- Ablation: nonlinear transformation in both dimensions improves Electricity MSE from 0.536 to 0.145 and Caiso from 0.242 to 0.094 relative to no transformation.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use the learnable condition in both forward and reverse processes instead of reverse process only (ablation) | Conditional DDPM · ETTh1 | MSE: 8% | Helped |
| use the learnable condition in both forward and reverse processes instead of reverse process only (ablation) | Conditional DDPM · Electricity | MSE: 16% | Helped |
| use the learnable condition in both forward and reverse processes instead of reverse process only (ablation) | Conditional DDPM · Traffic | MSE: 21% | Helped |
| add nonlinear transformation along the feature dimension (ablation) | CN-Diff without Tϕ · ETTh1 | MSE: 54% | Helped |
| add nonlinear transformation along the feature dimension (ablation) | CN-Diff without Tϕ · Electricity | MSE: 72% | Helped |
| add nonlinear transformation along the feature dimension (ablation) | CN-Diff without Tϕ · Caiso | MSE: 57% | Helped |
| add nonlinear transformation along the feature dimension (ablation) | CN-Diff without Tϕ · Wind | MSE: 51% | Helped |
| add nonlinear transformation along the forecast-window dimension (ablation) | CN-Diff without Tϕ · ETTh1 | MSE: 54% | Helped |
| add nonlinear transformation along the forecast-window dimension (ablation) | CN-Diff without Tϕ · Electricity | MSE: 70% | Helped |
| add nonlinear transformation along the forecast-window dimension (ablation) | CN-Diff without Tϕ · Caiso | MSE: 25% | Helped |
| add nonlinear transformation along the forecast-window dimension (ablation) | CN-Diff without Tϕ · Wind | MSE: 48% | Helped |
| add nonlinear transformation along both feature and forecast-window dimensions (ablation) | CN-Diff without Tϕ · ETTh1 | MSE: 57% | Helped |
Surprising findings
- Multivariate CN-Diff ranks 4th on Wind, where mr-Diff is best, which the authors attribute to multi-scale patterns in volatile wind data.
Limitations
- Wind dataset performance is weaker than mr-Diff, and multi-resolution extension is left for future work.
- Baseline results are copied from mr-Diff paper (Shen et al., 2024) rather than re-run under identical settings.
- Ablations are reported on a subset of datasets (ETTh1, Electricity, Traffic, Caiso, Wind).
Experimental setup
Datasets: NorPool Caiso Traffic Electricity Weather Exchange ETTh1 ETTm1 Wind
Benchmarks: NorPool Caiso Traffic Electricity Weather Exchange ETTh1 ETTm1 Wind
Metrics: MSE MAE
Baselines: mr-Diff TimeDiff TimeGrad CSDI SSSD D3VAE CPF PSA-GAN N-Hits FiLM DLinear NLinear
Builds on: DDPM CSDI TimeDiff NDM PriorGrad
Closest papers by meaning
- Auto-Regressive Moving Diffusion Models for Time Series Forecasting (AAAI 2025 · similarity 0.89)
- FIDE: Frequency-Inflated Conditional Diffusion Model for Extreme-Aware Time Series Generation (NeurIPS 2024 · similarity 0.89)
- Retrieval-Augmented Diffusion Models for Time Series Forecasting (NeurIPS 2024 · similarity 0.89)
- Non-stationary Diffusion For Probabilistic Time Series Forecasting (ICML 2025 · similarity 0.88)
- Diffusion-TS: Interpretable Diffusion for General Time Series Generation (ICLR 2024 · similarity 0.88)
- Latent Diffusion Transformer for Probabilistic Time Series Forecasting (AAAI 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
