AI Paper Atlas

Research map / Optimization / Distributed and compressed

CSER: Communication-efficient SGD with Error Reset

Cong Xie, Shuai Zheng, Sanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin

NeurIPS 2020 · Optimization › Distributed and compressed · approach: Gradient quantization and sparsification · 17 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use error reset and partial synchronization with aggressive compressionCSER · CIFAR-100training speedup: nearly $10\times$Improved
Use error reset and partial synchronization with aggressive compressionCSER · ImageNettraining speedup: 4.5×Improved
Use error reset rather than QSparse-local-SGD error feedbackCSER · CIFAR-100 test, R=256accuracy (%): diverge -> 86.68±0.07Improved
Use error reset rather than QSparse-local-SGD error feedbackCSER · CIFAR-100 test, R=1024accuracy (%): diverge -> 85.66±0.07Improved
Add gradient partial synchronization to model synchronization (ablation)CSER · CIFAR-100test accuracy (%)Improved
Remove gradient partial synchronization (ablation)CSER-PL · CIFAR-100test accuracy (%)Hurt
Use error assimilation without gradient partial synchronization (ablation)CSEA · CIFAR-100test accuracy (%)Hurt
Allocate some communication budget to gradient synchronization instead of all to model synchronizationCSER · theoretical compression-error examplecompression error bound: 400 -> less than 236Improved
Use CSER error reset instead of QSparse-local-SGD error feedbackCSER · theoretical example, H=8 and δ₁=1/2compression error bound: 832 -> 576Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy