Research map / Time series / Causal and generative time series
Residual TPP: A Unified Lightweight Approach for Event Stream Data Analysis
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes Residual TPP, which fits a Hawkes process, uses a weight-based Residual Events Decomposition (RED) to isolate poorly fit residual events, and trains an arbitrary neural TPP only on those residuals.
Problem
Neural TPPs are computationally expensive on long event sequences while classical TPPs such as the Hawkes process are too rigid and fail on outliers and complex dynamics; no decomposition method analogous to time-series STD exists for event streams.
Approach
A weight function derived from the integrated intensity of a fitted Hawkes process (with an influence function whose derivative is unbiased under Exp(1)) separates events well captured by the statistical model from residual events; a neural TPP is trained only on residuals and superposed with the Hawkes intensity via a mixing weight alpha equal to the residual fraction.
Key results
- Residual TPP variants improve log-likelihood over their neural TPP baselines on all six datasets, e.g., RES NHP reaches -1.825 vs NHP -2.031 on MIMIC-II and -0.712 vs -2.613 on Earthquake.
- Residual TPP lowers time RMSE on most datasets, e.g., RES RMTPP 0.504 vs RMTPP 0.613 on Amazon, and reduces type error (RES ODETPP 19.2% vs ODETPP 22.1% on MIMIC-II).
- End-to-end training time is lower for every Residual TPP than its baseline, e.g., RES ATTNHP 657.5s vs ATTNHP 1093s on Volcano and 5646s vs 6375s on Amazon.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add RED and residual modeling with ODETPP | ODETPP · MIMIC-II | log-likelihood: -1.855 -> -1.371 | Helped |
| Add RED and residual modeling with RMTPP | RMTPP · Retweet | log-likelihood: -4.382 -> -3.240 | Helped |
| Add RED and residual modeling with NHP | NHP · Earthquake | log-likelihood: -2.389 -> -1.930 | Helped |
| Add RED and residual modeling with NHP | NHP · StackOverflow | log-likelihood: -2.613 -> -0.712 | Helped |
| Add RED and residual modeling with NHP | NHP · Amazon | log-likelihood: -2.199 -> -1.303 | Helped |
| Add RED and residual modeling with NHP | NHP · Volcano | log-likelihood: 0.261 -> 0.435 | Helped |
| Use the alternative influence function instead of the original (ablation) | Residual TPP with RMTPP · MIMIC-II | log-likelihood: -2.045 -> -2.150 | Hurt |
| Use the alternative influence function instead of the original (ablation) | Residual TPP with RMTPP · Earthquake | log-likelihood: -3.689 -> -3.667 | No clear effect |
Surprising findings
- Residual TPP improves over baselines even on synthetic data where the true process is not a Hawkes process, which the authors interpret as RED being agnostic to the data-generating process.
- Some alternative influence-function variants (RES THP NEW, RES ATTNHP NEW) underperform the original on MIMIC-II log-likelihood, showing sensitivity to the choice of influence function.
Limitations
- Periodic baseline is not modeled in the experiments; the Hawkes component uses a fixed constant baseline.
- Hyperparameters a, b, and the residual threshold w are tuned per dataset, and the paper notes the choice affects the proportion of residual events.
- Theoretical unbiasedness holds asymptotically only when there is no event contamination and T goes to infinity, with rho1 = rho2.
Experimental setup
Datasets: MIMIC-II Retweet Earthquake StackOverflow Amazon Volcano
Benchmarks: MIMIC-II Retweet Earthquake StackOverflow Amazon Volcano
Metrics: test log-likelihood next-event time RMSE next-event type error rate end-to-end training time
Baselines: MHP RMTPP NHP SAHP THP AttNHP ODETPP FullyNN
Builds on: Hawkes process EasyTPP Seasonal-Trend Decomposition Zhang et al. 2025 unbiased weighting for event outliers
Closest papers by meaning
- EasyTPP: Towards Open Benchmarking Temporal Point Processes (ICLR 2024 · similarity 0.87)
- A Plug-and-Play Bregman ADMM Module for Inferring Event Branches in Temporal Point Processes (AAAI 2025 · similarity 0.86)
- Hyper Hawkes Processes: Interpretable Models of Marked Temporal Point Processes (NeurIPS 2026 · similarity 0.85)
- Decoupled Marked Temporal Point Process using Neural Ordinary Differential Equations (ICLR 2024 · similarity 0.85)
- Seahorse: A Unified Benchmarking Framework for Spatiotemporal Event Modeling (NeurIPS 2026 · similarity 0.85)
- Interacting Diffusion Processes for Event Sequence Forecasting (ICML 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
