Research map / Optimization / Nonconvex and smooth optimization
On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use unified shuffling rather than i.i.d. sampling | SGD in the general non-convex setting · Non-convex | gradient complexity to a stationary point: \Ocal\left(\sigma^2/\hat{\varepsilon}^2\right) -> \Ocal\left(n\sigma/\hat{\varepsilon}^{3/2}\right) | Helped |
| Use the proposed average-PL and generalized star-smooth-convex framework with small solution variance | Unified shuffling SGD · Non-convex over-parameterized finite-sum problems | gradient complexity to a global solution: \Ocal\left( \frac{n}{\hat{\varepsilon}^{3/2}} \right) | Helped |
| Use arbitrary unified shuffling schemes rather than restricting the analysis to one permutation strategy | Shuffling SGD · Non-convex over-parameterized finite-sum problems | convergence guarantee | Helped |
Closest papers by meaning
- Tighter Convergence Bounds for Shuffled SGD via Primal-Dual Perspective (NeurIPS 2024 · similarity 0.92)
- Improved Last-Iterate Convergence of Shuffling Gradient Methods for Nonsmooth Convex Optimization (ICML 2025 · similarity 0.91)
- On the Last-Iterate Convergence of Shuffling Gradient Methods (ICML 2024 · similarity 0.91)
- Revisiting Convergence: Shuffling Complexity Beyond Lipschitz Smoothness (ICML 2025 · similarity 0.90)
- On Convergence of Incremental Gradient for Non-convex Smooth Functions (ICML 2024 · similarity 0.90)
- The Global Convergence Time of Stochastic Gradient Descent in Non-Convex Landscapes: Sharp Estimates via Large Deviations (ICML 2025 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
