Research map / Graph learning / Knowledge and temporal graphs
Temporal Graph Benchmark for Machine Learning on Temporal Graphs
Shenyang Huang, Farimah Poursafaei, Jacob Danovitch, Matthias Fey, Weihua Hu, Emanuele Rossi, Jure Leskovec, Michael M. Bronstein, Guillaume Rabusseau, Reihaneh Rabbany
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use persistence forecast instead of a temporal graph model | Node affinity prediction · tgbn-trade | NDCG@10: 0.374 -> 0.855 (DyRep); 0.374 -> 0.855 (TGN) | Improved |
| Use moving average instead of a temporal graph model | Node affinity prediction · tgbn-genre | NDCG@10: 0.351 -> 0.509 (DyRep); 0.367 -> 0.509 (TGN) | Improved |
| Use moving average instead of a temporal graph model | Node affinity prediction · tgbn-reddit | NDCG@10: 0.312 -> 0.559 (DyRep); 0.315 -> 0.559 (TGN) | Improved |
| Use moving average instead of a temporal graph model | Node affinity prediction · tgbn-token | NDCG@10: 0.141 -> 0.508 (DyRep); 0.169 -> 0.508 (TGN) | Improved |
| Increase negative samples from 20 to all possible destinations (ablation) | Dynamic link prediction on tgbl-wiki · tgbl-wiki | MRR: 0.791 -> 0.711 | Hurt |
| Increase negative samples from 20 to 100 per positive (ablation) | Dynamic link prediction on tgbl-review · tgbl-review | MRR: 0.532 -> 0.349 | Hurt |
| Apply the TGB evaluation across diverse datasets rather than relying on tgbl-wiki alone | Temporal link prediction models · tgbl-wiki and tgbl-review | MRR: NAT: 0.749 -> 0.341; GraphMixer: 0.118 -> 0.521 | Mixed |
| Use a simple memory heuristic rather than DyRep | Dynamic link prediction · tgbl-coin | MRR: 0.452 -> 0.580 | Improved |
Closest papers by meaning
- TGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphs (NeurIPS 2024 · similarity 0.94)
- TGB-Seq Benchmark: Challenging Temporal GNNs with Complex Sequential Dynamics (ICLR 2025 · similarity 0.92)
- Temporal-Aware Evaluation and Learning for Temporal Graph Neural Networks (AAAI 2025 · similarity 0.90)
- No Metric to Rule Them All: Toward Principled Evaluations of Graph-Learning Datasets (ICML 2025 · similarity 0.89)
- Using Time-Aware Graph Neural Networks to Predict Temporal Centralities in Dynamic Graphs (NeurIPS 2024 · similarity 0.89)
- State Space Models on Temporal Graphs: A First-Principles Study (NeurIPS 2024 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
