Research map / Graph learning / GNN architectures
Geometric Generative Modeling with Noise-Conditioned Graph Networks
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes noise-conditioned graph networks (NCGNs) and a concrete instance, Dynamic Message Passing (DMP), whose connectivity range and coarse-grained resolution change with noise level in flow-based generative models of geometric graphs.
Problem
Flow-based generative models for geometric graphs (point clouds, spatial transcriptomics, images) use graph neural networks whose architecture is fixed across noise levels, limiting expressiveness.
Approach
Make the GNN architecture a function of noise level: at high noise use coarser graphs with broader connectivity (supernodes and larger kNN range), at low noise use fine, sparse graphs; theoretically motivated by an information-theoretic analysis showing optimal aggregation radius grows with noise.
Key results
- On ModelNet40, DMP reduces Wasserstein distance vs. KNN and long-short range baselines, averaging a 16.15% improvement across GCN and GAT.
- On ImageNet 256x256 unconditional generation, DiT-DMP improves FID from 84.051 (DiT) to 63.983 at identical computational complexity.
- On spatiotemporal transcriptomics, DMP has lowest W2 on GCN in most tasks (e.g., unconditional generation 0.812 vs. 0.880 fully connected) and comparable performance on GAT.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| adapt connectivity range and graph resolution to noise with DMP | GCN on ModelNet40 · ModelNet40 test | Wasserstein distance: 4.315 -> 4.215 | Helped |
| adapt connectivity range and graph resolution to noise with DMP | GAT on ModelNet40 · ModelNet40 test | Wasserstein distance: 5.598 -> 4.263 | Helped |
| use a linear instead of exponential adaptive schedule (ablation) | DMP with GAT · ModelNet40 | Wasserstein distance: 4.263 -> 4.495 | Hurt |
| use a logarithm instead of exponential adaptive schedule (ablation) | DMP with GAT · ModelNet40 | Wasserstein distance: 4.263 -> 4.860 | Hurt |
| use a ReLU instead of exponential adaptive schedule (ablation) | DMP with GAT · ModelNet40 | Wasserstein distance: 4.263 -> 4.485 | Hurt |
| adapt connectivity range and graph resolution to noise with DMP | GCN/GAT · Spatial transcriptomics unconditional generation | Wasserstein distance: 0.880/1.094 -> 0.812/0.834 | Helped |
| adapt connectivity range and graph resolution to noise with DMP | GCN/GAT · Spatial transcriptomics temporal trajectory prediction | Wasserstein distance: 1.060/1.271 -> 0.960/1.032 | Mixed |
| adapt connectivity range and graph resolution to noise with DMP | GCN/GAT · Spatial transcriptomics temporal interpolation | Wasserstein distance: 2.923/3.026 -> 2.880/2.912 | Helped |
| adapt connectivity range and graph resolution to noise with DMP | GCN/GAT · Spatial transcriptomics gene imputation | Wasserstein distance: 2.507/2.534 -> 2.529/2.575 | Mixed |
| adapt connectivity range and graph resolution to noise with DMP | GCN/GAT · Spatial transcriptomics space imputation | Wasserstein distance: 2.923/2.946 -> 2.907/2.913 | Helped |
| adapt connectivity range and graph resolution to noise with DMP | GCN/GAT · Spatial transcriptomics gene knockout | Wasserstein distance: 2.424/2.473 -> 2.392/2.397 | Mixed |
| replace fixed patch size and full attention with dynamic patch sizing and neighborhood attention | DiT · ImageNet 256×256 | FID: 84.051 -> 63.983 | Helped |
Surprising findings
- Logarithmic adaptive schedule underperforms the baselines on ModelNet40, while the other schedules beat them.
- On spatiotemporal gene imputation and knockout, DMP shows no significant advantage over baselines, and on GAT it is comparable rather than better.
Limitations
- DMP uses a predefined range and resolution schedule rather than a learned one.
- Theoretical analysis relies on simplifying assumptions (e.g., 1D continuous graph and specific correlation form), though empirical checks are provided.
- Gains on spatiotemporal gene imputation/knockout are not significant.
Experimental setup
Datasets: ModelNet40 simulated spatiotemporal transcriptomics (reaction-diffusion) ImageNet 256x256
Benchmarks: ModelNet40 simulated spatiotemporal transcriptomics ImageNet 256x256
Metrics: Wasserstein distance (W2) FID sFID IS Precision Recall
Baselines: KNN graph GNN Long-Short Range GNN Fully connected GNN DiT Random graph
Builds on: Torsional Diffusion FlexiViT Diffusion Transformer (DiT) flow matching neighborhood attention
Closest papers by meaning
- Smooth Interpolation for Improved Discrete Graph Generative Models (ICML 2025 · similarity 0.88)
- Efficient and Scalable Graph Generation through Iterative Local Expansion (ICLR 2024 · similarity 0.88)
- Spatio-Spectral Graph Neural Networks (NeurIPS 2024 · similarity 0.88)
- Graph Generation with Diffusion Mixture (ICML 2024 · similarity 0.88)
- Quality Measures for Dynamic Graph Generative Models (ICLR 2025 · similarity 0.88)
- Is Noise Conditioning Necessary? A Unified Theory of Unconditional Graph Diffusion Models (NeurIPS 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
