atlas

Research map / Graph learning / GNN architectures

Rethinking the Power of Graph Canonization in Graph Representation Learning with Stability

ICLR 2024 · Graph learning › GNN architectures · approach: Weisfeiler-Leman expressivity hierarchies · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes graph-canonization-enhanced GNNs (GC-GNN) that use canonical node orderings as positional encodings, identifies an expressivity-stability trade-off, and introduces universal graph canonization (UGC-GNN) with a sufficient condition based on dataset-wide node labeling.

Problem

GNNs are limited by 1-WL expressivity; graph canonization can distinguish non-isomorphic graphs, but canonical node labelings are unstable under small graph perturbations, hurting generalization to unseen graphs.

Approach

Use graph canonization outputs as one-hot node positional encodings to maximize expressivity, then resolve the resulting stability loss with a dataset-level "universal" canonization defined via a globally injective node labeling l(v|G) that is consistent across graphs, also applied in the readout layer via per-label weight matrices.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add graph canonization positional encodings to GIN/GCNGIN, GCN · EXP and CSL isomorphism teststest accuracy: EXP GCN 0.5000 -> 0.9267; GIN 0.5000 -> 0.9975Helped
add graph canonization (GC-GNN) to backbone GNNsTU datasets (GCN, GraphSAGE, GIN, GAT) · D&D, MUTAG, PROTEINS, PTC-MR, ENZYMESaccuracy: average improvement over backbone 6.0% to 28.2% across datasets; max 29.6% on D&DHelped
add graph canonization to GNN backbonesTU datasets · ENZYMES and PTC-MR (some GC-GNN variants)accuracy: GC-GNN (GIN) 30.7 on ENZYMES and 57.2 on PTC-MR, below several baselines such as GIN-AK+ and SignNetMixed
add general graph canonization (GC) to GIN on gene networksGIN on Mayo, RosMap, Cancer · gene network datasetsaccuracy: Mayo GIN 0.496 -> GC-GNN 0.483; RosMap GIN 0.471 -> GC-GNN 0.486 (Mayo worse)Hurt
replace general graph canonization with universal graph canonization (UGC) on GIN (ablation)GIN on gene networks and brain graphs · Mayo, RosMap, Cancer, fMRI-ABIDEaccuracy: Mayo 0.483 (GC) -> 0.624 (UGC); RosMap 0.486 -> 0.701; Cancer 0.539 -> 0.714; fMRI-ABIDE 0.610 -> 0.648Helped
add universal graph canonization (UGC) to GINGIN on DAG datasets · NA and BNRMSE (lower better): NA 0.264 (DAGNN best baseline) -> 0.253; BN 0.122 -> 0.120Helped
add universal graph canonization to GINGIN on gene networks · Mayo, RosMap, Canceraccuracy: Mayo 0.496 -> 0.624 (GIN backbone to UGC-GNN); RosMap 0.471 -> 0.701Helped
add general graph canonization (GC) to GCN on gene networks (ablation)GCN · Mayo, RosMap, Cancer Subtypeaccuracy: Mayo GCN 0.561 -> 0.522; RosMap 0.520 -> 0.508; Cancer 0.593 -> 0.544Mixed
add universal graph canonization (UGC) to GCN (ablation)GCN · Mayo, RosMap, Cancer Subtypeaccuracy: Mayo 0.561 -> 0.572 (UGC); RosMap 0.520 -> 0.658; Cancer 0.593 -> 0.619Mixed
add graph canonization to GIN on molecular datasets (ablation)GIN · ogbg-molhiv and ogbg-molpcbaAUC / AP: molhiv GIN 0.7744 -> GN-GIN 0.7705 (drop); molpcba 0.2703 -> 0.2781 (gain)Mixed

Surprising findings

Limitations

Experimental setup

Datasets: EXP CSL TU datasets (PROTEINS, PTC-MR, MUTAG, ENZYMES, D&D) Mayo RosMap Cancer Subtype fMRI ABIDE NA (ENAS neural architectures) BN (bnlearn Bayesian networks) ogbg-molhiv ogbg-molpcba

Benchmarks: EXP CSL TU datasets Mayo RosMap Cancer Subtype fMRI ABIDE NA BN ogbg-molhiv ogbg-molpcba

Metrics: accuracy F1 score RMSE Pearson's r ROC-AUC AP

Baselines: GCN GIN GAT GraphSAGE Nested GNN GraphSNN GIN-AK+ SignNet ESAN DropGNN GNN-RNI PPGN

Builds on: Weisfeiler-Lehman test Nauty Graph Isomorphism Network Nested GNN positional encoding for graph transformers

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy