atlas

Research map / Graph learning / Knowledge and temporal graphs

Long Range Propagation on Continuous-Time Dynamic Graphs

ICML 2024 · Graph learning › Knowledge and temporal graphs · approach: Continuous-time dynamic graph learning · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CTAN, an ODE-based continuous-time dynamic graph network built from anti-symmetric weights and forward Euler steps, to propagate information over long spatial and temporal ranges, and introduces long-range benchmarks (temporal path graph, temporal PascalVOC-SP).

Problem

Continuous-time dynamic graph (C-TDG) models perform poorly on long-range tasks that require correlating information from far away in space (higher-order neighbors) or time (past events), because of over-squashing and dissipative dynamics in message passing and RNN memories.

Approach

Use a non-dissipative ODE whose weight matrix is anti-symmetric (minus a small gamma*I for Euler stability), discretized by forward Euler with per-event sub-problems whose initial state carries the node's previous embedding, so information persists over time and propagates spatially as the number of steps grows.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CTAN instead of DyGFormerTemporal path graph sequence classification · T-PathGraph n=3accuracy: 100.0$_{\pm0.0}$ vs 100.0$_{\pm0.0}$No clear effect
Use CTAN instead of JODIETemporal path graph sequence classification · T-PathGraph n=15accuracy: 60.0$_{\pm14.91}$ -> 93.47$_{\pm8.78}$Helped
Use CTAN instead of DyRepTemporal path graph sequence classification · T-PathGraph n=20accuracy: 50.47$_{\pm2.88}$ -> 88.93$_{\pm12.06}$Helped
Use CTAN instead of DyGFormerTemporal Pascal VOC classification, 1 GCL · Temporal Pascal VOC sc=10F1-score: 8.45$_{\pm0.13}$ -> 7.89$_{\pm0.33}$Hurt
Use CTAN instead of TGATTemporal Pascal VOC classification, 3 GCLs · Temporal Pascal VOC sc=30F1-score: 8.79$_{\pm0.29}$ -> 10.16$_{\pm0.52}$Helped
Use CTAN instead of TGATTemporal Pascal VOC classification, 5 GCLs · Temporal Pascal VOC sc=30F1-score: 10.38$_{\pm0.7}$ -> 10.41$_{\pm0.52}$No clear effect
Use CTAN instead of TGNFuture link prediction · WikipediaAUC: 95.60$_{\pm0.18}$ -> 97.55$_{\pm0.09}$Helped
Use CTAN instead of TGNFuture link prediction · RedditAUC: 98.23$_{\pm0.10}$ -> 98.61$_{\pm0.04}$Helped
Use CTAN instead of TGATFuture link prediction · LastFMAUC: 81.53$_{\pm0.34}$ -> 83.81$_{\pm0.92}$Helped
Use CTAN instead of TGNFuture link prediction · MOOCAUC: 90.74$_{\pm0.99}$ -> 92.47$_{\pm0.78}$Helped

Surprising findings

Limitations

Experimental setup

Datasets: Temporal path graph (synthetic, introduced) Temporal PascalVOC-SP (derived from PascalVOC-SP / Pascal VOC 2011) Wikipedia Reddit LastFM MOOC

Benchmarks: Temporal path graph sequence classification Temporal PascalVOC-SP Wikipedia Reddit LastFM MOOC

Metrics: accuracy F1-score AUC

Baselines: DyRep JODIE TGAT TGN GraphMixer DyGFormer EdgeBank

Builds on: A-DGN Temporal Graph Networks (TGN) Graph Neural Diffusion / GDE Long Range Graph Benchmark PascalVOC-SP TGAT

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy