AI Paper Atlas

Research map / Optimization / Nonconvex and smooth optimization

Optimal Stochastic and Online Learning with Individual Iterates

Yunwen Lei, Peng Yang, Ke Tang, Ding-Xuan Zhou

NeurIPS 2019 · Optimization › Nonconvex and smooth optimization · approach: Stochastic gradient last-iterate analysis · 3 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use OCMDI individual iterate instead of uniform averaging (ablation)SCMD output · Binary classification test sets (SGD, SPGD)test objective valueImproved
Use suffix averaging instead of weighted averaging (ablation)SCMD output · Binary classification test setstest objective valueImproved
Use OCMDI instead of random-index output (RAND) (ablation)SCMD output · Binary classification test setstest objective valueImproved
Use OCMDI instead of last iterate (LAST) (ablation)SCMD output · Binary classification test setstest objective valueNo clear effect
Use OCMDI instead of uniform averaging (ablation)SCMD output · Tomography reconstruction N=64number of non-zero components: 4096 -> 1828Improved
Use OCMDI instead of suffix averaging (ablation)SCMD output · Tomography reconstruction N=64number of non-zero components: 1943 -> 1828Improved
Use OCMDI instead of weighted averaging (ablation)SCMD output · Tomography reconstruction N=64number of non-zero components: 3727 -> 1828Improved
Use suffix averaging output instead of random-index output (RAND) (ablation)SCMD output · Tomography reconstructiontraining speedImproved
Choose T* as argmin of A_t over [T,2T-1] instead of Algorithm 1 rule (ablation)OCMDI · ExperimentsperformanceHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy