AI Paper Atlas

Research map / Federated learning and privacy / Differential privacy

A(DP)^2SGD: Asynchronous Decentralized Parallel Stochastic Gradient Descent with Differential Privacy

Jie Jeff Xu, Wei Zhang, Wang Fei

TPAMI 2021 · Federated learning and privacy › Differential privacy · approach: Differentially private federated learning · 47 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace synchronous SGD with asynchronous decentralized A(DP)^2SGD under small noiseDP training · CIFAR-10 (ResNet-18)test accuracy (%): 91.67 -> 91.64No clear effect
replace SYNC with A(DP)^2SGD under medium noiseDP training · CIFAR-10 (EfficientNet-B0)test accuracy (%): 88.13 -> 87.01Hurt
replace SYNC with A(DP)^2SGD under large noiseDP training · CIFAR-10 (ResNet-18)test accuracy (%): 83.40 -> 81.01Hurt
replace SYNC with A(DP)^2SGD under medium noiseDP training · SWB300 (LSTM)held-out loss: 1.752 -> 1.732Improved
use ADPSGD instead of SYNC without noisetraining · CIFAR-10 (ResNet-18)test accuracy (%): 94.01 -> 94.97Improved
use ADPSGD instead of SYNC with a random learner 2X slowertraining speed · CIFAR-10convergence vs runtimeImproved
use ADPSGD instead of SYNC with one learner 10X slowertraining speed · CIFAR-10convergence vs runtimeImproved
use ADPSGD instead of SYNC with 2X batch size and 2X learning ratetraining stability · CIFAR-10 (EfficientNet-B0) and SWB300convergenceImproved
A(DP)^2SGD at large noise for SENet-18SYNC · CIFAR-10 (SENet-18)test accuracy (%): 10.00Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy