atlas

Research map / Graph learning / Graph self-supervised learning

Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective

NeurIPS 2024 · Graph learning › Graph self-supervised learning · approach: Heterophily and imbalance on graphs · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Revisits self-supervised heterogeneous graph learning as spectral clustering and proposes SCHOOL, which adds a rank-constrained affinity matrix and node- and cluster-level consistency losses.

Problem

Self-supervised heterogeneous graph learning (SHGL) message passing introduces inter-class noise into graph structures, and existing methods underuse cluster-level information, hurting downstream performance.

Approach

Theoretically shows that meta-path-based and adaptive-graph SHGL methods reduce to spectral clustering with regularization, then learns a rank-constrained affinity matrix (exactly c connected components) via a spectral loss on a projected orthogonal cluster assignment, combined with node-level and cluster-level consistency constraints.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use SCHOOL instead of HEROnode classification · ACM, Yelp, DBLP, and AminerMacro-F1 and Micro-F1: 92.2$\pm$0.5 -> 92.7$\pm$0.6; 92.1$\pm$0.7 -> 92.6$\pm$0.5; 92.4$\pm$0.7 -> 93.0$\pm$0.7; 92.3$\pm$0.6 -> 92.8$\pm$0.4; Helped
add spectral loss $\mathcal{L}_{sp}$ (ablation)SCHOOL node classification · ACMMacro-F1: 86.9$\pm$0.7 -> 92.7$\pm$0.6Helped
add node-level consistency loss $\mathcal{L}_{nc}$ (ablation)SCHOOL node classification · ACMMacro-F1: 89.0$\pm$0.5 -> 92.7$\pm$0.6Helped
add cluster-level consistency loss $\mathcal{L}_{cc}$ (ablation)SCHOOL node classification · ACMMacro-F1: 88.9$\pm$0.7 -> 92.7$\pm$0.6Helped
add all three objective components rather than the best variant (ablation)SCHOOL node classification · four heterogeneous graph datasetsMacro-F1 and Micro-F1: 1.8%Helped

Limitations

Experimental setup

Datasets: ACM DBLP Aminer Yelp Photo Computers

Benchmarks: ACM Yelp DBLP Aminer Photo Computers

Metrics: Macro-F1 Micro-F1 clustering metrics

Baselines: DeepWalk GCN GAT Mp2vec HAN HGT DMGI DMGIattn HDMI HeCo HGCML CPIM

Builds on: HERO DMGI HeCo spectral clustering Info-NCE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy