AI Paper Atlas

Research map / Optimization / Distributed and compressed

Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD

Kun Yuan, Sulaiman A. Alghunaim, Xinmeng Huang

JMLR 2023 · Optimization › Distributed and compressed · approach: Decentralized optimization algorithms · 24 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add multi-round gossip and gradient accumulation to D2/Exact-Diffusion (ablation)D2/Exact-Diffusion · transient stage, generally convextransient stage order: Omega(n^3/(1-beta)^2) -> Omega~(n/(1-beta))Improved
add multi-round gossip and gradient accumulation to D2/Exact-Diffusion (ablation)D2/Exact-Diffusion · transient stage, strongly convextransient stage order: Omega~(n/(1-beta)) -> Omega~(1/(1-beta)^(1/2))Improved
remove data heterogeneity influence by using D2/Exact-Diffusion instead of D-SGDD-SGD · transient stage, generally convextransient stage order: Omega(n^3/(1-beta)^4) -> Omega(n^3/(1-beta)^2)Improved
remove data heterogeneity influence by using D2/Exact-Diffusion instead of D-SGDD-SGD · transient stage, strongly convextransient stage order: Omega~(n/(1-beta)^2) -> Omega~(n/(1-beta))Improved
grow cycle from 32 to 64 nodes (1/(1-beta) from 78.07 to 311.51) (ablation)D-SGD · logistic regression, cycle graphconvergence performance: 78.07 -> 311.51Hurt
homogeneous data (sigma_h^2 = 0) instead of heterogeneous (ablation)D-SGD vs D2/ED · least squares, cycle of 32 nodesconvergenceNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy