atlas

Research map / Graph learning / GNN architectures

Generalizing CNNs to graphs with learnable neighborhood quantization

NeurIPS 2024 · Graph learning › GNN architectures · approach: Deep graph convolution and simplification · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes Quantized Graph Convolution Networks (QGCNs), which decompose graph convolution into non-overlapping sub-kernels with a learnable QuantNet assigning neighbors to sub-kernels, reducing to a 2D CNN on grid graphs and matching or beating GNN baselines on graph benchmarks.

Problem

Existing spatial GNNs do not truly generalize the CNN convolution layer: they lack fixed neighborhood sizes and node orderings, so they fail to reduce to a CNN on array data and lose CNN's local inductive bias.

Approach

Quantize local neighborhoods into a fixed set of non-overlapping sub-kernels via masks; a satisficing angular mapping reproduces 3x3 CNN convolution exactly on 2D grid graphs, and a learnable QuantNet (MLP + Gumbel-softmax) generalizes the assignment to arbitrary graphs; wrapped in a residual block (QGRL/QGRN).

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace CNN convolution layers with QGCL layersCNN architecture · MNIST, Fashion-MNIST, and CIFAR-10test accuracy: 98.92 ± 0.10 -> 98.98 ± 0.04; 92.56 ± 0.18 -> 92.39 ± 0.13; 80.21 ± 0.29 -> 79.59 ± 0.35No clear effect
use QGRN instead of the strongest listed GNN baselinegraph classification models · AIDS, Frankenstein, Mutag, Synthie, Letters (high), Enzymes, COIL-DEL, Mutagenicity, Proteins-Full, Letters (low), and Letters (med)test accuracy: 99.17 ± 0.14 -> 99.50 ± 0.10; 66.74 ± 00.42 -> 75.58 ± 0.40; 98.37 ± 01.41 -> 99.99 ± 00.26; 92.68 ± 0.11 -> 99.99 ± 0.2Helped
use QGRN instead of the strongest listed GNN baselinenode classification models · Computers, Cora, PubMed, Chameleon, and Squirreltest accuracy: 91.66 ± 0.05 -> 90.02 ± 0.02; 88.34 ± 0.30 -> 89.02 ± 0.14; 88.97 ± 0.09 -> 89.11 ± 0.15; 78.11 ± 0.29 -> 74.15 ± 0.37; Mixed
increase QGRN depth from 3 to 18 layers (ablation)QGRN · AIDSmean test accuracy: 99.50 -> 99.00Hurt
increase QGRN depth from 3 to 18 layers (ablation)QGRN · Letters (high)mean test accuracy: 94.10 -> 90.86Hurt

Surprising findings

Limitations

Experimental setup

Datasets: MNIST FashionMNIST CIFAR-10 AIDS Letters Enzymes Coil-Del Frankenstein Mutag Mutagenicity Proteins Synthie

Benchmarks: MNIST FashionMNIST CIFAR-10 AIDS Letters Enzymes Coil-Del Frankenstein Mutag Mutagenicity Proteins Synthie

Metrics: test accuracy parameter count FLOPs inference latency MSE cross-entropy AUC

Baselines: GCNConv ChebConv GraphConv SGConv GENConv GeneralConv GATv2Conv TransformerConv SGCN EGConv

Builds on: GCN SGCN DeeperGCNs (GENConv) ResNet Gumbel-softmax

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy