atlas

Research map / Federated learning and privacy / Differential privacy

Breaking the Communication-Privacy-Accuracy Tradeoff with $f$-Differential Privacy

NeurIPS 2023 · Federated learning and privacy › Differential privacy · approach: Privacy accounting and mechanisms · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use ternary stochastic compression instead of SQKRDistributed mean estimation · Distributed mean estimation (N=1000, d=250)type II error at α = 0.5: 0.068 -> 0.484Helped
Use ternary stochastic compression rather than SQKR at the same MSE and communication costDistributed mean estimation · Distributed mean estimationε-DP: {1,2,5} -> {0.05,0.2,3.9}Helped
Apply tight f-DP analysis rather than the prior analysisBinomial noise · Binomial noise (M=500, p=0.5)ε in (ε, δ)-DP: 3.18 -> 1.67Helped
Apply tight f-DP analysis rather than the prior analysisBinomial noise · Binomial noise (M=500, p=0.5)δ in (ε, δ)-DP: 0.044 -> 0.039Helped
Add sparsification to the two-level stochastic sign compressor (ablation)Ternary stochastic compressor · Scalar compressorf-DP privacy guarantee: f^ternary(α) > f^sto-sign for α ∈ [(A-c)/(2B), 1-(A+c)/(2B)]Helped
Increase sparsity by increasing B at fixed A (ablation)Ternary stochastic compressor · Scalar compressorf-DP privacy guarantee: f^ternary(α) approaches 1-αHelped
Remove sparsification (set A=B) (ablation)Ternary stochastic compressor · Distributed mean estimationcommunication overheadHurt
Use the ternarize compressor special case (ablation)Ternary stochastic compressor · Scalar compressorprivacy guarantee: δ = c/B and ε = 0Mixed
Sparsify the Gaussian mechanism (ablation)Gaussian mechanism · Distributed mean estimationMSEHurt
Set AB = c² + σ² and use ternary compression at large d (ablation)Ternary stochastic compressor · Distributed mean estimationprivacy guarantee and varianceNo clear effect
Use ternary compression instead of the Gaussian mechanism for xᵢⱼ ∈ {-c,c} at large d (ablation)Distributed mean estimation · Distributed mean estimationprivacy guarantee and varianceNo clear effect
Increase M for binomial noise (ablation)Binomial noise · Binomial noiseprivacy protectionHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy