AI Paper Atlas

Research map / Federated learning and privacy / Communication-efficient FL

SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression

Zhize Li, Haoyu Zhao, Boyue Li, Yuejie Chi

NeurIPS 2022 · Federated learning and privacy › Communication-efficient FL · approach: Federated optimization algorithms · 10 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
random-k sparsification compression (k=d/20) instead of uncompressed LDP-SGD/LDP-SVRGCDP-SGD, SoteriaFL-SGD, SoteriaFL-SVRG · a9a logistic regression with nonconvex regularizer, eps=1,5,10convergence vs communication roundsHurt
random-k sparsification compression instead of uncompressed baselinesCDP-SGD, SoteriaFL · a9a, eps=1,5,10utility/training loss vs communication bitsImproved
shifted compression (SoteriaFL) instead of direct compression (CDP-SGD) (ablation)SoteriaFL-SGD · a9a logistic regressionutility and training lossImproved
SVRG variance reduction instead of SGD inside SoteriaFL (ablation)SoteriaFL · a9a logistic regressionutilityImproved
random-k sparsification compression instead of uncompressed baselinesCDP-SGD, SoteriaFL · MNIST shallow NN, eps=1,2,4,8,16test accuracy vs communication bitsImproved
compression instead of uncompressed baselines as eps increases (weaker privacy)compressed algorithms · MNIST shallow NNgap in convergence vs roundsMixed
shifted compression (SoteriaFL-SGD) instead of direct compression (CDP-SGD) (ablation)SoteriaFL-SGD · MNIST shallow NNutility and test accuracyImproved
SoteriaFL-SVRG instead of CDP-SGDSoteriaFL-SVRG · MNIST shallow NNutility/test accuracyHurt
shifted compression (SoteriaFL) with local-DP noise instead of CDP-SGDLDP-FL theory · nonconvex LDP, theorynumber of communication rounds for same utilityImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy