atlas

Research map / Graph learning / Graph self-supervised learning

HiGen: Hierarchical Graph Generative Networks

ICLR 2024 · Graph learning › Graph self-supervised learning · approach: Diffusion-based graph generation · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes HiGen, a hierarchical coarse-to-fine graph generative model that generates Louvain-partitioned communities in parallel and then predicts cross-community bipartite edges, using a multinomial/stick-breaking factorization for integer edge weights.

Problem

Generating realistic generic graphs while capturing their hierarchical community structure, with scalability to large graphs and integer-valued (multi)edge weights, which existing autoregressive, GAN, and diffusion generators handle poorly.

Approach

Model graph generation as a recursive coarse-to-fine process over Louvain hierarchies: communities at each level are generated in parallel conditioned on parent super-nodes, then cross-community bipartite edges are predicted by a separate GraphGPS-based network; edge weights are modeled via a multinomial factorized into binomial/multinomial stick-breaking steps.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use mixture of multinomial distributions for leaf-edge output instead of HiGen's mixture of Bernoulli (ablation)HiGen · SBMorbit MMD: 0.0352 -> 0.0604Hurt
use mixture of multinomial distributions for leaf-edge output instead of HiGen's mixture of Bernoulli (ablation)HiGen · Proteinclustering MMD: 0.0435 -> 0.109Hurt
use mixture of multinomial distributions for leaf-edge output instead of HiGen's mixture of Bernoulli (ablation)HiGen · Enzymeclustering MMD: 0.038 -> 0.157Hurt
use mixture of multinomial distributions for leaf-edge output instead of HiGen's mixture of Bernoulli (ablation)HiGen · EgoFrechet Distance: 5.24 -> 12.2Hurt
use mixture of multinomial distributions for leaf-edge output instead of HiGen's mixture of Bernoulli (ablation)HiGen · EgoGNN RBF: 0.0454 -> 0.0420Helped
use mixture of multinomial distributions for leaf-edge output instead of HiGen's mixture of Bernoulli (ablation)HiGen · SBMdegree MMD: 0.0019 -> 0.0017Mixed
use mixture of multinomial distributions for leaf-edge output instead of HiGen's mixture of Bernoulli (ablation)HiGen · Proteindegree MMD: 0.0012 -> 0.0041Hurt
use hierarchical HiGen rather than DiGressgraph generation · SBMclustering MMD: 0.0498 -> 0.0498No clear effect
use hierarchical HiGen rather than SPECTREgraph generation · Proteinorbit MMD: 0.0267 -> 0.0234Helped
use hierarchical HiGen rather than DiGressgraph generation · Enzymeorbit MMD: 0.002 -> 7.2e-4Helped
use hierarchical HiGen rather than DiGressgraph generation · Egoclustering MMD: 0.0092 -> 0.0031Helped

Surprising findings

Limitations

Experimental setup

Datasets: Stochastic Block Model (SBM) Protein Enzyme Ego (CiteSeer 3-hop) Point Cloud

Benchmarks: SBM Protein Enzyme Ego Point Cloud

Metrics: MMD degree distribution MMD clustering coefficient MMD orbit count MMD spectrum GNN RBF MMD Frechet Distance

Baselines: GraphRNN GRAN SPECTRE DiGress GDSS GraphARM EDGE DiscDDPM

Builds on: GRAN GraphGPS GraphRNN Louvain algorithm DeepGMG

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy