atlas

Research map / Probabilistic and scientific modeling / Molecules and proteins

DiffCast: A Unified Framework via Residual Diffusion for Precipitation Nowcasting

CVPR 2024 · Probabilistic and scientific modeling › Molecules and proteins · approach: Spatiotemporal forecasting and imputation · 68 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes DiffCast, a residual diffusion framework that wraps any deterministic spatio-temporal backbone with a diffusion model (GTUNet) that models local stochastic residuals for precipitation nowcasting, trained end-to-end.

Problem

Precipitation nowcasting from radar echo sequences: deterministic models produce blurry forecasts with faded high-value echoes, while probabilistic/diffusion models produce realistic textures but inaccurate rainfall positions.

Approach

Decompose precipitation evolution into a global deterministic motion trend (from any backbone predictor) plus a local stochastic residual modeled autoregressively by a segment-level residual diffusion model conditioned on the backbone's hidden motion features, trained jointly end-to-end with a deterministic loss.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Equip SimVP with DiffCast residual diffusionSimVP · SEVIRCSI: 0.2662 -> 0.3077Helped
Equip SimVP with DiffCast residual diffusionSimVP · MeteoNetCSI: 0.3346 -> 0.3511Helped
Equip MAU with DiffCast residual diffusionMAU · Shanghai RadarCSI: 0.3996 -> 0.4089Helped
Equip MAU with DiffCast residual diffusionMAU · CIKMCSI: 0.2936 -> 0.3158Helped
Set α=1, removing the deterministic loss (ablation)DiffCast SimVP · SEVIRCSI: 0.3077 -> 0.2430Hurt
Set α=0, removing the denoising loss (ablation)DiffCast SimVP · SEVIRCSI: 0.3077 -> 0.2578Hurt
Freeze the separately trained SimVP backbone instead of end-to-end training (ablation)DiffCast SimVP · SEVIRCSI: 0.3077 -> 0.2739Hurt
Freeze the separately trained Earthformer backbone instead of end-to-end training (ablation)DiffCast Earthformer · SEVIRCSI: 0.2823 -> 0.2622Hurt
Freeze the separately trained PhyDnet backbone instead of end-to-end training (ablation)DiffCast PhyDnet · SEVIRCSI: 0.2757 -> 0.2603Hurt
Remove GlobalNet (ablation)DiffCast SimVP · SEVIRCSI: 0.3077 -> 0.2719Hurt
Remove GlobalNet (ablation)DiffCast Earthformer · SEVIRCSI: 0.2823 -> 0.2558Hurt
Remove GlobalNet (ablation)DiffCast PhyDnet · SEVIRCSI: 0.2757 -> 0.2648Hurt

Surprising findings

Limitations

Experimental setup

Datasets: SEVIR MeteoNet Shanghai Radar CIKM AI Lab precipitation

Benchmarks: SEVIR MeteoNet Shanghai Radar CIKM

Metrics: CSI CSI-pool4 CSI-pool16 HSS LPIPS SSIM

Baselines: SimVP Earthformer MAU ConvGRU PhyDnet MCVD PreDiff STRPM

Builds on: DDPM DDIM MCVD SimVP Earthformer

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy