atlas

Research map / Graph learning / GNN architectures

Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach

NeurIPS 2024 · Graph learning › GNN architectures · approach: Robustness, privacy, and fairness of GNNs · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes an efficient graph property inference attack that trains only a few reference GNNs and generates many approximated shadow models via graph-unlearning-style model approximation, selected by edit-distance diversity and an approximation-error criterion.

Problem

Graph property inference attacks against shared GNN models require training hundreds to thousands of shadow models, which is computationally expensive; the attack should reveal sensitive graph-level distribution properties (e.g., gender ratio) efficiently.

Approach

Replace most shadow training with model approximation: train a few reference GNNs, create augmented graphs by removing nodes and edges, approximate each perturbed model with a Newton/influence-style update, and select perturbations that maximize edit-distance diversity while bounding approximation error via a theoretical gradient-norm criterion solved as a quadratic integer program.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use model approximation to generate approximated shadow models instead of training numerous shadow modelsGraph property inference attack · Six real-world scenariosattack accuracy: 67.3\% -> 69.0\% (average increase of 2.7\%)Helped
Use model approximation instead of training shadow modelsGraph property inference attack · Six real-world scenariosROC-AUC: 63.6\% -> 66.4\% (average increase of 4.1\%)Helped
Use model approximation instead of conventional shadow-model trainingGraph property inference attack · Six real-world scenariosruntime: 6.5$\times$ fasterHelped
Replace structure-aware random walks with simple random walks for reference-graph sampling (ablation)Proposed attack · Facebook node propertyattack accuracyHurt
Remove the augmentation selector and use random removal to obtain augmented graphs (ablation)Proposed attack · Facebook node propertyattack accuracyHurt
Ignore approximation error and select augmentations only to maximize diversity (ablation)Proposed attack · Facebook node propertyattack accuracyHurt
Ignore diversity and select augmentations only to minimize approximation error (ablation)Proposed attack · Facebook node propertyattack accuracyHurt
Increase the number of reference graphs (ablation)Proposed attack · Evaluated attack settingsattack accuracyMixed
Increase the number of selected augmented graphs (ablation)Proposed attack · Evaluated attack settingsattack accuracyMixed

Surprising findings

Limitations

Experimental setup

Datasets: Facebook Pubmed Pokec Pokec-100M

Benchmarks: Facebook node/link property inference Pubmed node/link property inference Pokec node/link property inference Pokec-100M scalability cross-dataset Facebook<->Pokec

Metrics: attack accuracy ROC-AUC runtime (seconds)

Baselines: GPIA PIR-D PIR-S AIA PIA-MP

Builds on: GPIA graph unlearning influence-function updates Louvain community detection PIR (permutation-invariant property inference)

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy