atlas

Research map / Graph learning / GNN architectures

A Generalized Neural Diffusion Framework on Graphs

AAAI 2024 · Graph learning › GNN architectures · approach: GNN generalization theory

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a general diffusion framework with a fidelity term that unifies GCN/SGC, APPNP, GAT, AMP and DAGNN, and derives HiD-Net, a second-order (high-order neighbor-aware) graph diffusion network motivated by label monophily.

Problem

Existing diffusion-based GNNs lack a common diffusion framework that formally unifies them, and first-order diffusion assumes homophily among 1-hop neighbors, which fails on heterophily graphs and under noisy edges or features.

Approach

A general diffusion equation with a fidelity term (pull toward initial features) plus a divergence of diffusion flux, shown to recover several GNNs as special cases; HiD-Net adds a 2-hop regularized diffusion term motivated by the monophily property of labels, yielding a second-order random-walk-like propagation.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use HiD-Net instead of APPNPnode classification · CoraF1-macro: 82.2 -> 82.8Helped
Use HiD-Net instead of DGCnode classification · CiteseerF1-micro: 72.5 -> 73.2Helped
Use HiD-Net instead of APPNPnode classification · PubmedF1-micro: 79.9 -> 81.1Helped
Use HiD-Net instead of DGCnode classification · ChameleonF1-macro: 58.0 -> 61.0Helped
Use HiD-Net instead of DGCnode classification · SquirrelF1-macro: 42.1 -> 47.5Helped
Use HiD-Net instead of DGCnode classification · ActorF1-macro: 31.6 -> 25.7Hurt
Use HiD-Net instead of GRAND++node classification · ogbn-arxivAccuracy: 71.9 -> 72.2Helped
Increase alpha from 0 to 1 (ablation)HiD-Net · citation graphs; Chameleon; Squirrel; ActoraccuracyMixed
Increase beta from 0 to 1 (ablation)HiD-Net · all datasetsaccuracyHelped
Increase gamma from 0 to 0.6 (ablation)HiD-Net · all datasetsaccuracyNo clear effect
Increase gamma from 0 to 0.6 (ablation)HiD-Net · Cora and ChameleonaccuracyMixed

Surprising findings

Limitations

Experimental setup

Datasets: Cora Citeseer Pubmed Chameleon Squirrel Actor ogbn-arxiv

Benchmarks: Cora Citeseer Pubmed Chameleon Squirrel Actor ogbn-arxiv

Metrics: F1-macro F1-micro AUC accuracy

Baselines: GCN GAT APPNP GRAND GRAND++ DGC ADC

Builds on: APPNP GRAND DGC ADC Graph Heat Equation

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy