atlas

Research map / Time series / Causal and generative time series

Beyond Point Prediction: Score Matching-based Pseudolikelihood Estimation of Neural Marked Spatio-Temporal Point Process

ICML 2024 · Time series › Causal and generative time series · approach: Generative temporal point processes

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes SMASH, a normalization-free score-matching pseudolikelihood estimator for neural marked spatio-temporal point processes that also yields confidence intervals/regions via Langevin-based sampling.

Problem

Learning neural marked spatio-temporal point processes requires an intractable normalization integral in the likelihood, and existing methods provide only point predictions without uncertainty quantification (confidence intervals/regions).

Approach

Decompose the joint intensity into time-mark and conditional spatial parts, apply score matching (with denoising) to the conditional time and location densities and a conditional log-likelihood for marks, giving a normalization-free pseudolikelihood; then generate samples with Langevin dynamics and Tweedie denoising to build confidence intervals/regions.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use SMASH instead of the strongest reported baselineSMASH · EarthquakeCStime (%): 14.80±0.67 -> 3.53±0.55Helped
Use SMASH instead of DSTPPSMASH · CrimeCSspace (%): 1.92±1.48 -> 1.08±0.12Helped
Use SMASH instead of DSTPPSMASH · FootballMAEtime (%): 3.76±0.24 -> 3.40±0.08Helped
Use SMASH instead of SMURF-THPSMASH · StackOverflowCS (%): 0.34±0.04 -> 0.29±0.12Helped
Use SMASH instead of SMURF-THPSMASH · RetweetCS (%): 0.35±0.04 -> 0.27±0.09Helped
Use SMASH instead of SMURF-THPSMASH · MIMICCS (%): 1.14±0.23 -> 0.85±0.38Helped
Add Gaussian noise and use denoising score matching (ablation)SMASH · EarthquakeCS-timeHelped
Increase the Gaussian noise scale (ablation)SMASH · EarthquakeCS-timeMixed
Increase the Gaussian noise scale (ablation)SMASH · EarthquakeCS-spaceHurt
Increase the Gaussian noise scale (ablation)SMASH · EarthquakeMAEHelped
Increase the mark-loss weight α (ablation)SMASH · EarthquakeCS-timeHurt
Increase the mark-loss weight α (ablation)SMASH · EarthquakeCS-spaceHurt

Surprising findings

Limitations

Experimental setup

Datasets: Earthquake (USGS Japan 1990-2020) Crime (Atlanta Police Department 2015-2020) Football (WyScout Open Access) StackOverflow Retweet MIMIC-II Financial Transactions (NYSE)

Benchmarks: Earthquake Crime Football StackOverflow Retweet MIMIC-II Financial Transactions

Metrics: Calibration Score MAE Accuracy Expected Calibration Error

Baselines: Poisson process Hawkes process NJSDE NSTPP NSMPP DeepSTPP DSTPP NHP NCE-TPP SAHP THP SMURF-THP

Builds on: score matching (Hyvärinen 2005) denoising score matching (Vincent 2011) Transformer Hawkes process (THP) SMURF-THP DSTPP

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy