atlas

Research map / Federated learning and privacy / Personalized and heterogeneous FL

FedGCR: Achieving Performance and Fairness for Federated Learning with Distinct Client Types via Group Customization and Reweighting

AAAI 2024 · Federated learning and privacy › Personalized and heterogeneous FL · approach: Federated learning with pretrained models · 7 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes FedGCR, a federated learning method for distinct client types that combines prompt-tuned ViT customization (FedGC) with group-wise reweighting aggregation (FedGR) using anonymized GMM clustering of client representations.

Problem

Federated learning where clients belong to distinct groups (client types, e.g., different data domains), where existing methods focus on individual-client performance and fairness and ignore group-level disparities and customization.

Approach

Uses type-specific prompts generated by GC-Net from frozen ViT features, added to global visual prompts, plus a fairness-aware aggregation that reweights clients by both their own loss and their anonymously inferred cluster's average loss, with a scheduled balance parameter.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use FedGCR instead of FedSAMFederated learning on Digit-Five · Digit-Five, DIF=10Avg accuracy: 64.06 (1.47) -> 82.74 (0.47)Helped
Use FedGCR instead of AFLFederated learning on Digit-Five · Digit-Five, DIF=10σtype: 23.58 (0.49) -> 12.26 (0.36)Helped
Use FedGCR instead of AFLFederated learning on Digit-Five · Digit-Five, DIF=10σclient: 18.70 (0.27) -> 8.52 (0.19)Helped
Use FedGCR instead of FedSAMFederated learning on DomainNet · DomainNet, DIF=10Avg accuracy: 81.04 (0.28) -> 81.88 (0.52)Helped
Use FedGCR instead of AFLFederated learning on DomainNet · DomainNet, DIF=10σtype: 16.83 (0.19) -> 14.88 (0.08)Helped
Use FedGCR instead of AFLFederated learning on DomainNet · DomainNet, DIF=10σclient: 11.09 (0.04) -> 9.07 (0.17)Helped
Add FedGR to FedGC (ablation)FedGCR on Digit-Five · Digit-Five, DIF=10Avg accuracy: 79.49 -> 82.74Helped
Add FedGR to FedGC (ablation)FedGCR on Digit-Five · Digit-Five, DIF=10σdomain: 16.57 -> 12.26Helped
Add FedGR to FedGC (ablation)FedGCR on Digit-Five · Digit-Five, DIF=10σclient: 11.61 -> 8.52Helped
Add FedGC to FedGR (ablation)FedGCR on Digit-Five · Digit-Five, DIF=10Avg accuracy: 63.01 -> 82.74Helped
Add FedGC to FedGR (ablation)FedGCR on Digit-Five · Digit-Five, DIF=10σdomain: 23.03 -> 12.26Helped
Add FedGC to FedGR (ablation)FedGCR on Digit-Five · Digit-Five, DIF=10σclient: 17.75 -> 8.52Helped

Surprising findings

Limitations

Experimental setup

Datasets: Digit-Five DomainNet PACS

Benchmarks: Digit-Five DomainNet

Metrics: average accuracy sigma_type sigma_client

Baselines: FedAvg q-FFL AFL TERM Harmo-FL FedSAM FedMix

Builds on: Visual Prompt Tuning q-FFL FedAvg Gaussian Mixture Model clustering

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy