AI Paper Atlas

Research map / Federated learning and privacy / Differential privacy

Enabling Fast Differentially Private SGD via Just-in-Time Compilation and Vectorization

Pranav Shankar Subramani, Nicholas Vadivelu, Gautam Kamath

NeurIPS 2021 · Federated learning and privacy › Differential privacy · approach: DP-SGD refinements · 18 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use JAX or Custom TFP for private trainingDPSGD · MNIST CNNmedian runtime per epoch: 6.50 -> 0.53Improved
Use JAX or Custom TFP for private trainingDPSGD · IMDb LSTMmedian runtime per epoch: 407 -> 8.2Improved
Add VMAP (ablation)JAX DPSGD · Adult logistic regressionmedian runtime per epoch: 1040 -> 16.4Improved
Add JIT (ablation)JAX DPSGD · Adult logistic regressionmedian runtime per epoch: 1040 -> 1.08Improved
Use both VMAP and JIT (ablation)JAX DPSGD · Adult logistic regressionmedian runtime per epoch: 1040 -> 0.231Improved
Add VMAP (ablation)JAX DPSGD · CIFAR10 CNNmedian runtime per epoch: 3840 -> 64.8Improved
Add JIT (ablation)JAX DPSGD · CIFAR10 CNNmedian runtime per epoch: 3840 -> 84.0Improved
Use both VMAP and JIT (ablation)JAX DPSGD · CIFAR10 CNNmedian runtime per epoch: 3840 -> 7.28Improved
Add XLA compilation (ablation)Custom TFP DPSGD · Adult FCNNmedian runtime per epoch: 12.7 -> 1.83Improved
Use graph-mode vectorization (ablation)Custom TFP DPSGD · Adult FCNNmedian runtime per epoch: 12.7 -> 0.770Improved
Add vectorization to XLA (ablation)Custom TFP DPSGD · Adult FCNNmedian runtime per epoch: 1.83 -> 0.209Improved
Add XLA compilation (ablation)Custom TFP DPSGD · MNIST CNNmedian runtime per epoch: 32.5 -> 19.5Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy