AI Paper Atlas

Research map / Graph learning / GNN architectures

On the Connection Between MPNN and Graph Transformer

Chen Cai, Truong Son Hy, Rose Yu, Yusu Wang

ICML 2023 · Graph learning › GNN architectures · approach: Expressive equivariant message passing · 9 citations (OpenAlex)

This paper tried a common change: Add positional encoding

add positional encoding to DeepSets-based MPNN+VN · ogbg-ppa / ogbg-molhiv / ogbg-molpcba / ogbg-code2 · accuracy / AUROC / AP / F1: ppa 0.8055 (NoPE) vs 0.8027 (PE); molhiv 0.7676 vs 0.7687; molpcba 0.2823 vs 0.2848; code2 0.1727 vs 0.1719 No clear effect

What 646 accepted papers report for this change

See this change in detailMatched by the wording of each paper's own result, read by AI from the full text. Papers report gains more often than failures, so this shows what gets published, not the chance a change works.

Read the paper

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add virtual node to MPNN (GCN, GINE, GatedGCN)MPNN on PEPTIDES-FUNC and PEPTIDES-STRUCT · LRGBTest AP / Test MAE: GCN AP 0.5930 -> 0.6623; GatedGCN+RWSE AP 0.6069 -> 0.6685Improved
add virtual node to GatedGCN+RWSEGatedGCN+RWSE on PEPTIDES-FUNC · LRGB PEPTIDES-FUNCTest AP: 0.6069 -> 0.6685Improved
add positional encoding to DeepSets-based MPNN+VN (ablation)MPNN + VN on OGB graph datasets · ogbg-ppa / ogbg-molhiv / ogbg-molpcba / ogbg-code2accuracy / AUROC / AP / F1: ppa 0.8055 (NoPE) vs 0.8027 (PE); molhiv 0.7676 vs 0.7687; molpcba 0.2823 vs 0.2848; code2 0.1727 vs 0.1719No clear effect
replace GIN+VN virtual node with DeepSets-based MPNN+VN (no PE)GIN+virtual node on OGB · ogbg-ppaAccuracy: 0.7037 -> 0.8055Improved
DeepSets-based MPNN+VN (no PE) vs GIN+VNPCQM4Mv2 validation · PCQM4Mv2MAE: GIN-virtual 0.1083 -> MPNN+VN+NoPE medium 0.0889Improved
add virtual node to MPNN for sea surface temperature forecasting (ablation)MPNN on SST · SST 4/2/1 weekMSE: 4wk 0.2917 -> 0.2806; 2wk 0.2281 -> 0.2130; 1wk 0.1613 -> 0.1540Improved
MPNN+VN vs Linear Transformer+LapPE on SSTMPNN + VN · SST 4/2/1 weekMSE: 4wk 0.2806 vs 0.2818 (better); 2wk 0.2130 vs 0.2191 (better); 1wk 0.1540 vs 0.1610 (better); but TF-Net is best at 2 andMixed
add virtual node to GCN on PEPTIDES-STRUCTGCN · LRGB PEPTIDES-STRUCTTest MAE: 0.3496 -> 0.2488 (lower is better)Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy