Research map / Graph learning / Graph self-supervised learning
Similarity-Navigated Conformal Prediction for Graph Neural Networks
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes SNAPS, a post-hoc conformal prediction method for GNN node classification that aggregates APS non-conformity scores over feature-similarity k-NN nodes and one-hop neighbors, yielding smaller prediction sets and higher singleton hit ratio at valid coverage.
Problem
Conformal prediction sets for semi-supervised node classification with GNNs are often large and inefficient, and singleton hit ratio is low; existing graph-aware CP (DAPS) only uses structural neighbors.
Approach
Aggregate basic non-conformity scores (APS) across nodes likely sharing the ego node's label, selected by feature-similarity k-NN and one-hop structural neighbors, with a weighted combination that preserves exchangeability and marginal coverage.
Key results
- On OGBN Products (alpha=0.05, GCN), SNAPS reduces average prediction set size from 14.92 (APS) to 7.68 while keeping coverage at 0.950.
- Average over 10 graph datasets at alpha=0.05: SNAPS size 3.17 vs APS 5.23 and DAPS 3.79; singleton hit ratio 52.31% vs DAPS 48.01%.
- On ImageNet with ResNeXt101 at alpha=0.1, SNAPS reduces set size from 19.64 to 4.08 with coverage 0.900.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Aggregate feature-similarity and one-hop neighborhood scores using SNAPS | APS with GCN · Products | Size: 14.92 -> 7.68 | Helped |
| Aggregate feature-similarity and one-hop neighborhood scores using SNAPS | APS with GCN · Average across ten graph datasets | SH%: 40.22 -> 52.31 | Helped |
| Use SNAPS instead of APS | ImageNet ResNeXt101 · ImageNet, α=0.1 | Size: 19.64/4.08 | Helped |
| Aggregate similarity-neighbor scores with SNAPS | APS with FSGNN · Chameleon | Size: 1.95 -> 1.70 | Helped |
| Remove original scores (ablation) | Full SNAPS with GCN · CoraML | Size: 1.68 -> 1.72 | Mixed |
| Remove neighborhood scores (ablation) | Full SNAPS with GCN · CoraML | Size: 1.68 -> 2.40 | Hurt |
| Remove feature similarity scores (ablation) | Full SNAPS with GCN · CoraML | Size: 1.68 -> 1.87 | Hurt |
| Remove original scores (ablation) | Full SNAPS with GCN · Products | Size: 7.68 -> 7.65 | No clear effect |
| Remove neighborhood scores (ablation) | Full SNAPS with GCN · Products | Size: 7.68 -> 13.89 | Hurt |
| Remove feature similarity scores (ablation) | Full SNAPS with GCN · Products | Size: 7.68 -> 10.81 | Hurt |
| Set λ=μ=1/3 | SNAPS with GCN · CoraML | Size: 2.50 -> 1.74 | Helped |
| Use SNAPS instead of APS | GCN · CoraML | Size: 3.29 -> 1.29 | Helped |
Surprising findings
- Oracle experiments show that aggregating scores of randomly chosen same-label nodes sharply reduces set size, motivating label-aware aggregation.
- Feature-similarity k-NN selects same-label nodes with reasonable accuracy only when k is not very large; performance declines slightly for extremely large k.
Limitations
- Node selection via feature similarity is computationally inefficient and not highly accurate at identifying same-label nodes.
- Method is limited to transductive setting and focuses on homophilous graphs; heterophily results are preliminary.
- Hyperparameters lambda, mu, k tuned on calibration split; theoretical validity proposition assumes aggregated nodes share the ego label.
Experimental setup
Datasets: CoraML PubMed CiteSeer CoraFull* Coauthor CS Coauthor Physics Amazon Photos Amazon Computers OGBN Arxiv OGBN Products ImageNet Chameleon
Benchmarks: CoraML PubMed CiteSeer CoraFull* Coauthor CS Coauthor Physics Amazon Photos Amazon Computers OGBN Arxiv OGBN Products ImageNet Chameleon
Metrics: coverage average prediction set size singleton hit ratio size-stratified coverage violation
Baselines: APS RAPS DAPS CF-GNN
Builds on: adaptive prediction sets DAPS split conformal prediction
Closest papers by meaning
- Distribution Free Prediction Sets for Node Classification (ICML 2023 · similarity 0.90)
- GRAPHLCP: Structure-Aware Localized Conformal Prediction on Graphs (NeurIPS 2026 · similarity 0.89)
- Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Training (AAAI 2025 · similarity 0.87)
- Valid Conformal Prediction for Dynamic GNNs (ICLR 2025 · similarity 0.86)
- Conformal Structured Prediction (ICLR 2025 · similarity 0.86)
- Random Search Neural Networks for Efficient and Expressive Graph Learning (NeurIPS 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
