Research map / Optimization / Distributed and compressed
Asynchronous Distributed Learning : Adapting to Gradient Delays without Prior Knowledge
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| anytime online-to-batch conversion (querying gradients at iterate averages) instead of SGD iterates | SGD under gradient delays · Fashion-MNIST logistic regression, delay sweep | test accuracy under increasing delay | Helped |
| anytime online-to-batch conversion instead of standard SGD iterates | SGD with tuned learning rate · Fashion-MNIST logistic regression, tau_t=500 learning-rate sweep | sensitivity to learning rate (range of high accuracy) | Helped |
Closest papers by meaning
- Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity (NeurIPS 2026 · similarity 0.91)
- Enhancing Parallelism in Decentralized Stochastic Convex Optimization (ICML 2025 · similarity 0.88)
- Faster Stochastic Optimization with Arbitrary Delays via Adaptive Asynchronous Mini-Batching (ICML 2025 · similarity 0.88)
- SLowcalSGD : Slow Query Points Improve Local-SGD for Stochastic Convex Optimization (NeurIPS 2024 · similarity 0.88)
- Do We Need Asynchronous SGD? On the Near-Optimality of Synchronous Methods (NeurIPS 2026 · similarity 0.87)
- AsyncMesh: Fully Asynchronous Optimization for Data and Pipeline Parallelism (NeurIPS 2026 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.