AI Paper Atlas

Research map / Optimization / Distributed and compressed

GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning

Anis Elgabli, Jihong Park, Amrit S. Bedi, Mehdi Bennis, Vaneet Aggarwal

JMLR 2020 · Optimization › Distributed and compressed · approach: Compressed distributed optimization · 58 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use GADMM instead of LAG-WKlinear regression, synthetic data · Linear regression (synthetic, N=24)iterations to 1e-4: 44,933 -> 558Improved
use GADMM instead of GDlogistic regression · Logistic regression (N=26)total communication cost: 31,104 -> 1,712Improved
use GADMM instead of LAG-WK with few workerslinear regression, N=14 · Linear regression (N=14)total communication cost: 820 -> 1,092Hurt
use GADMM instead of LAG-WK in linear regressionsynthetic data N=24, rho 3 and 5 · Linear regression (synthetic, N=24)total communication cost: 6 and 9 times lower than that of LAG-WKImproved
vary penalty rho between 3, 5 and 7 (ablation)GADMM · Linear regression (synthetic, N=24)iterations to 1e-4: less than 1,000 iterations for rho 3, 5, 7No clear effect
lower rho when local data are highly correlated across workers (ablation)GADMM · Body Fat (real linear regression)convergence speedImproved
higher rho when local data are independent across workers (ablation)GADMM · Synthetic linear regressionconvergence speedImproved
add dynamic chain reconstruction (D-GADMM) to GADMM (ablation)GADMM, linear regression N=50 · Synthetic linear regression (N=50, topology change every 15 iterations)iterations and TC to 1e-4Improved
use D-GADMM with graph changed every iteration instead of standard ADMMlinear regression N=24 · Synthetic linear regression (N=24, rho=1)total communication cost: 40 times lessImproved
use standard ADMM instead of GADMMlinear regression N=24 · Synthetic linear regression (N=24)iterations / TC to 1e-4: 4 times higher cost than GADMMMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy