atlas

Research map / Graph learning / Graph self-supervised learning

HC-GAE: The Hierarchical Cluster-based Graph Auto-Encoder for Graph Representation Learning

NeurIPS 2024 · Graph learning › Graph self-supervised learning · approach: Semi-supervised node representation learning · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes HC-GAE, a hierarchical cluster-based graph auto-encoder that uses hard assignment to split graphs into isolated subgraphs in the encoder and soft assignment to expand nodes in the decoder, evaluated on node and graph classification benchmarks.

Problem

GAEs struggle to produce universal representations for both node-level and graph-level downstream tasks (topological missing from over-emphasis on node features) and suffer from over-smoothing in deep GNN encoders/decoders.

Approach

Encoder decomposes the graph via hard node assignment into separated subgraphs, compressing each into a coarsened node so message passing stays within subgraphs; decoder uses soft assignment to expand coarsened nodes back to the original graph; the loss sums a local subgraph KL term (regularizer) and a global reconstruction term over features and structure.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use HC-GAE instead of S2GAENode classification · Coraaccuracy: 86.15$\pm$0.25 -> 87.97$\pm$0.10Helped
Use HC-GAE instead of S2GAENode classification · CiteSeeraccuracy: 74.60$\pm$0.06 -> 75.29$\pm$0.09Helped
Use HC-GAE instead of S2GAENode classification · PubMedaccuracy: 86.91$\pm$0.28 -> 87.56$\pm$0.35Helped
Use HC-GAE instead of S2GAENode classification · Computersaccuracy: 90.94$\pm$0.08 -> 91.07$\pm$0.14Helped
Use HC-GAE instead of GraphMAENode classification · CSaccuracy: 93.47$\pm$0.04 -> 92.28$\pm$0.07Hurt
Use HC-GAE instead of S2GAEGraph classification · IMDB-Baccuracy: 75.76$\pm$0.62 -> 76.72$\pm$0.60Helped
Use HC-GAE instead of S2GAEGraph classification · IMDB-Maccuracy: 51.79$\pm$0.36 -> 51.90$\pm$1.47Helped
Use HC-GAE instead of S2GAEGraph classification · PROTEINSaccuracy: 76.37$\pm$0.43 -> 78.13$\pm$1.37Helped
Use HC-GAE instead of S2GAEGraph classification · COLLABaccuracy: 81.02$\pm$0.53 -> 80.41$\pm$0.02Hurt
Use HC-GAE instead of InfoGCLGraph classification · MUTAGaccuracy: 91.20$\pm$1.30 -> 92.38$\pm$1.17Helped
Replace the separated-subgraph, hard-assignment encoder with soft assignment (HC-GAE-SE) (ablation)HC-GAE · Graph classificationaccuracyHurt

Surprising findings

Limitations

Experimental setup

Datasets: Cora CiteSeer PubMed Computers CS IMDB-B IMDB-M PROTEINS COLLAB MUTAG

Benchmarks: Cora CiteSeer PubMed Computers CS IMDB-B IMDB-M PROTEINS COLLAB MUTAG

Metrics: accuracy average rank

Baselines: DGI VGAE SSL-GCN GraphSage GraphMAE S2GAE WLSK DGCNN DiffPool Graph2Vec InfoGCL

Builds on: Graph Auto-Encoder GCN VGAE DiffPool

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy