Research map / Optimization / Distributed and compressed
Fast Asynchronous Parallel Stochastic Gradient Descent: A Lock-Free Approach with Convergence Guarantee
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace Hogwild! with lock-free AsySVRG (variance-reduced parallel SGD) | Hogwild! (10 threads) · rcv1, real-sim, news20, epsilon (logistic regression) | convergence rate per effective pass | Helped |
| replace Hogwild! with AsySVRG | Hogwild!-10 · four LibSVM datasets | relative CPU time to reach error | Helped |
| remove locks (lock-free update) from AsySVRG (ablation) | AsySVRG · four LibSVM datasets | speedup over 1 thread | Helped |
| remove locks from AsySVRG (ablation) | AsySVRG · four LibSVM datasets | convergence per effective pass | No clear effect |
| increase thread count from 1 to 10 | AsySVRG · news20 | convergence per effective pass | No clear effect |
Closest papers by meaning
- Parallel Asynchronous Stochastic Variance Reduction for Nonconvex Optimization (AAAI 2017 · similarity 0.93)
- Asynchronous Mini-Batch Gradient Descent with Variance Reduction for Non-Convex Optimization (AAAI 2017 · similarity 0.93)
- Asynchronous Decentralized Parallel Stochastic Gradient Descent (ICML 2018 · similarity 0.92)
- Ringmaster ASGD: The First Asynchronous SGD with Optimal Time Complexity (ICML 2025 · similarity 0.91)
- Faster Derivative-Free Stochastic Algorithm for Shared Memory Machines (ICML 2018 · similarity 0.91)
- Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity (NeurIPS 2026 · similarity 0.90)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.