atlas

Research map / Graph learning / GNN architectures

Expressivity and Generalization: Fragment-Biases for Molecular GNNs

ICML 2024 · Graph learning › GNN architectures · approach: Weisfeiler-Leman expressivity hierarchies · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes Fragment-WL, a WL-style expressivity hierarchy for fragment-biased molecular GNNs, and FragNet, a message-passing model over a higher-level fragment graph with a rings-paths fragmentation and ordinal fragment encoding.

Problem

Fragment-biased GNNs are empirically strong for molecules but lack theoretical expressivity analysis, and higher-order GNNs generalize poorly; the paper asks how fragment information should be encoded and how expressive these models are.

Approach

Defines Fragment-WL variants (NF-WL, FR-WL, HLG-WL) that perform WL on graphs augmented with fragment nodes and higher-level fragment edges, yielding a strict expressivity hierarchy; builds FragNet, which message-passes on the augmented graph, uses a rings-paths fragmentation that covers the whole molecule, and an ordinal (class + size) fragment embedding that generalizes to unseen fragments.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use FragNet instead of GRITPeptides-struct prediction · Peptides-structMAE: 0.2460 ± 0.0012 -> 0.2462 ± 0.0021No clear effect
Use FragNet instead of GRITPeptides-func prediction · Peptides-funcAP: 0.6988 ± 0.0082 -> 0.6678 ± 0.005Hurt
Use FragNet instead of CIN++GNNs on Peptides-func · Peptides-funcAP: 0.6569 ± 0.0117 -> 0.6678 ± 0.005Helped
Use FragNet instead of GRITZINC 10k prediction · ZINC 10kMAE: 0.059 ± 0.002 -> 0.0775 ± 0.005Hurt
Use FragNet instead of GRITZINC full prediction · ZINC fullMAE: 0.023 ± 0.001 -> 0.0237 ± 0.00No clear effect
Use FragNet instead of GRITZINC 10k prediction with unseen 7-rings · ZINC 10k, unseen 7-ring testMAE: 0.61 -> 0.34Helped
Use FragNet instead of GRITZINC-full molecules grouped by rarest fragment frequency · ZINC full, rarest fragment <0.1%MAE: 9.5 -> 5.3Helped
Use FragNet instead of GRITZINC-full molecules grouped by rarest fragment frequency · ZINC full, rarest fragment <1%MAE: 0.26 -> 0.15Helped
Use FragNet instead of GRITZINC-full molecules grouped by rarest fragment frequency · ZINC full, rarest fragment <10%MAE: 0.026 -> 0.045Hurt
Use FragNet instead of GRITZINC-full molecules grouped by rarest fragment frequency · ZINC full, rarest fragment ≥10%MAE: 0.018 -> 0.021Hurt
Use FragNet instead of GRITZero-shot transfer from ZINC to QM9 · QM9MAE: 1.22 -> 1.12Helped

Surprising findings

Limitations

Experimental setup

Datasets: ZINC 10k ZINC full Peptides-struct Peptides-func QM9

Benchmarks: ZINC 10k ZINC full Peptides-struct Peptides-func QM9

Metrics: MAE AP recovery rate substructure count accuracy

Baselines: GRIT GPS Graphormer CIN++ HIMP GSN Autobahn GatedGCN SAN RingGNN

Builds on: Weisfeiler-Leman test HIMP CIN GSN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy