atlas

Research map / Federated learning and privacy / Personalized and heterogeneous FL

Federated Self-Explaining GNNs with Anti-shortcut Augmentations

ICML 2024 · Federated learning and privacy › Personalized and heterogeneous FL · approach: Federated semi-supervised and graph learning

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes FedGR, a federated graph rationalization method that uses complement-aware and difference-aware augmenters to generate shortcut-conflicted samples and learn self-explaining GNNs without shortcuts.

Problem

Graph rationalization methods for explainable GNN graph classification rely on shortcuts in data; existing de-shortcut methods are designed for centralized data and are under-explored in federated learning, where clients have client-specific shortcuts.

Approach

Two augmenters produce shortcut-conflicted samples per client: a complement-aware augmenter that merges a rationale with randomly permuted complements (enforced by a contrastive constraint for sufficiency and independence), and a difference-aware augmenter that masks node features so samples cross the local model's decision boundary while keeping the global model's prediction.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the difference-aware augmenter (ablation)FedGR · Spurious-Motif bias=0.5ACC: 0.4493 ± 0.0238 -> 0.4610 ± 0.0289Helped
add the difference-aware augmenter (ablation)FedGR · Spurious-Motif bias=0.7ACC: 0.5293 ± 0.0483 -> 0.5538 ± 0.0398Helped
add the difference-aware augmenter (ablation)FedGR · Spurious-Motif bias=0.9ACC: 0.4333 ± 0.0471 -> 0.4977 ± 0.0315Helped
add the difference-aware augmenter (ablation)FedGR · MolHIVAUC: 0.7214 ± 0.0124 -> 0.7387 ± 0.0186Helped
add the difference-aware augmenter (ablation)FedGR · MolToxCastAUC: 0.6222 ± 0.0055 -> 0.6316 ± 0.0054Helped
add the difference-aware augmenter (ablation)FedGR · MolBBBPAUC: 0.6623 ± 0.0033 -> 0.6690 ± 0.0174Helped
add the difference-aware augmenter (ablation)FedGR · MolSIDERAUC: 0.5886 ± 0.0047 -> 0.6017 ± 0.0202Helped
add the complement-aware augmenter (ablation)FedGR · Spurious-Motif bias=0.5ACC: 0.4571 ± 0.0372 -> 0.4610 ± 0.0289Helped
add the complement-aware augmenter (ablation)FedGR · Spurious-Motif bias=0.7ACC: 0.5438 ± 0.0551 -> 0.5538 ± 0.0398Helped
add the complement-aware augmenter (ablation)FedGR · Spurious-Motif bias=0.9ACC: 0.4682 ± 0.0388 -> 0.4977 ± 0.0315Helped
add the complement-aware augmenter (ablation)FedGR · MolHIVAUC: 0.7321 ± 0.0233 -> 0.7387 ± 0.0186Helped
add the complement-aware augmenter (ablation)FedGR · MolToxCastAUC: 0.6298 ± 0.0035 -> 0.6316 ± 0.0054Helped

Surprising findings

Limitations

Experimental setup

Datasets: Spurious-Motif OGB MolHIV OGB MolToxCast OGB MolBBBP OGB MolSIDER

Benchmarks: Spurious-Motif OGB MolHIV OGB MolToxCast OGB MolBBBP OGB MolSIDER

Metrics: ACC AUC Precision@5

Baselines: Vanilla GR DIR DisC CAL GSAT DARE InterRAT RGDA

Builds on: Vanilla graph rationalization DIR CAL GSAT FedAvg

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy