atlas

Research map / Graph learning / GNN architectures

Homomorphism Counts for Graph Neural Networks: All About That Basis

ICML 2024 · Graph learning › GNN architectures · approach: Substructure-aware GNN expressivity · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Shows that injecting the homomorphism basis of a graph motif parameter into GNNs is strictly more expressive than injecting subgraph or homomorphism counts alone, at no extra computational cost, and validates this on ZINC, QM9, COLLAB and BREC.

Problem

GNNs cannot count graph patterns such as cycles, and it is unclear whether subgraph counts or homomorphism counts are the better features to inject for expressiveness; the paper asks which information strictly subsumes both.

Approach

Inject the homomorphism basis of a graph motif parameter (the homomorphism counts of all quotient graphs in its support, e.g. spasm of the pattern) rather than the parameter itself; the paper proves this is at least as expressive and strictly more expressive under mild conditions, including node-level (anchored) variants.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add node-level anchored homomorphism counts from spasm°(C7) ∪ spasm°(C8)GAT, GCN, GIN, and BasePlanE · ZINC-12KMAE: GAT: 0.457 ± 0.004 -> 0.147 ± 0.004; GCN: 0.417 ± 0.007 -> 0.165 ± 0.004; GIN: 0.294 ± 0.012 -> 0.146 ± 0.005; BasePlanEHelped
Add graph-level Hom(Ωcon≤5 ∪ {C6}) featuresR-GCN · QM9, all 13 propertiesMAEHelped
Add node-level homomorphism counts from the P6 basisGCN and GAT · COLLABHits@50: GCN: 46.13% -> 50.35%; GAT: 48.27% -> 51.62%Helped
Encode Hom(spasm(P6)) counts with an MLP instead of positional encoding (ablation)GAT · COLLABHits@50Hurt
Use positional encoding for Hom(spasm(P6)) counts (ablation)GAT · COLLABHits@50Helped
Vary positional encoding dimension (ablation)GAT with Hom(spasm(P6)) · COLLABHits@50No clear effect
Add homomorphism counts of Ωcon≤5GIN and PPGN · BREC totalcorrectly distinguished graph-pair percentage: GIN + Hom: 69%; PPGN + Hom: 76.25%; PPGN: 58.2%; GSN: 63.5%; I²-GNN: 70.2%Mixed

Surprising findings

Limitations

Experimental setup

Datasets: ZINC-12K QM9 COLLAB (OGB) BREC

Benchmarks: ZINC-12K QM9 COLLAB (OGB link prediction) BREC

Metrics: mean absolute error Hits@50 number of distinguished graph pairs (percentage)

Baselines: GAT GCN GIN BasePlanE R-GCN PPGN GSN I2-GNN 2-WL^4 (higher-order)

Builds on: subgraph GNNs (GSN) homomorphism expressivity (Dell et al.) graph motif parameters (Roberson / Curticapean et al.) PPGN BasePlanE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy