atlas

Research map / Time series / Long-term forecasting

TimeMixer: Decomposable Multiscale Mixing for Time Series Forecasting

ICLR 2024 · Time series › Long-term forecasting · approach: Lightweight long-term forecasters · 93 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes TimeMixer, a fully MLP-based multiscale-mixing forecaster that decomposes downsampled series into seasonal and trend parts, mixes them bottom-up and top-down respectively, and ensembles multi-scale predictors.

Problem

Long-term and short-term time series forecasting with intricate, mixed temporal variations; existing methods rely on decomposition or multiperiodicity but do not exploit multiscale information jointly in past extraction and future prediction.

Approach

Downsample the input into multiple scales, decompose each into seasonal and trend parts, mix seasonal parts bottom-up (fine-to-coarse) and trend parts top-down (coarse-to-fine) via past-decomposable-mixing blocks, then sum predictions from one linear predictor per scale (future-multipredictor-mixing).

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add Future-Multipredictor-Mixing to combine predictions from multiple scales (ablation)TimeMixer · M4 weighted averageOWA: 0.925 -> 0.840Helped
Add seasonal mixing (ablation)TimeMixer · M4 weighted averageOWA: 0.962 -> 0.840Helped
Add trend mixing (ablation)TimeMixer · M4 weighted averageOWA: 0.941 -> 0.840Helped
Use bottom-up seasonal and top-down trend mixing instead of top-down seasonal and bottom-up trend mixing (ablation)TimeMixer · M4 weighted averageOWA: 0.954 -> 0.840Helped
Use separate seasonal and trend mixing directions rather than top-down mixing for both (ablation)TimeMixer · M4 weighted averageOWA: 0.871 -> 0.840Helped
Use separate seasonal and trend mixing directions rather than bottom-up mixing for both (ablation)TimeMixer · M4 weighted averageOWA: 0.859 -> 0.840Helped
Add decomposition before multiscale mixing (ablation)TimeMixer · M4 weighted averageOWA: 0.851 -> 0.840Helped
Add decomposition before multiscale mixing (ablation)TimeMixer · M4 weighted averageOWA: 0.850 -> 0.840Helped
Add Past-Decomposable-Mixing (ablation)TimeMixer · M4 weighted averageOWA: 0.916 -> 0.840Helped
Increase the number of scales from 1 to 3 (ablation)TimeMixer · ETTm1MSE: 0.326 -> 0.320Helped
Increase the number of scales from 3 to 4 (ablation)TimeMixer · ETTm1MSE: 0.320 -> 0.321; 0.454 -> 0.454Mixed
Increase the number of PDM layers from 1 to 2 (ablation)TimeMixer · ETTm1MSE: 0.328 -> 0.320Helped

Surprising findings

Limitations

Experimental setup

Datasets: ETTh1 ETTh2 ETTm1 ETTm2 Weather Solar-Energy Electricity Traffic PEMS03 PEMS04 PEMS07 PEMS08

Benchmarks: ETTh1 ETTh2 ETTm1 ETTm2 Weather Solar-Energy Electricity Traffic PEMS03 PEMS04 PEMS07 PEMS08

Metrics: MSE MAE MAPE RMSE SMAPE MASE OWA GPU memory running time

Baselines: PatchTST TimesNet Crossformer MICN FiLM DLinear FEDformer Stationary Autoformer Informer SCINet N-HiTS

Builds on: Autoformer series decomposition MLP-Mixer DLinear PatchTST

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy