Research map / Bandits and online learning / Online convex optimization and games
Online mirror descent and dual averaging: keeping pace in the dynamic case
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add dual stabilization with γ_t = η_{t+1}/η_t to OMD | OMD with dynamic learning rates · Online convex optimization with unbounded Bregman divergence | regret: Ω(T) -> O(√T) | Helped |
| Use dual stabilization with η_t = 2 √(ln(n) / t) | OMD · Prediction with expert advice, ĝ_t ∈ [0,1]^n | regret: Regret(T,z) ≤ √(T ln n) | Helped |
| Use a self-confident learning rate based on the learner's past cost | Dual-stabilized OMD · Prediction with expert advice, ĝ_t ∈ [0,1]^n | first-order regret: Regret(T,z) ≤ 2√(ln(n) L_T^*) + 8 ln n | Helped |
| Use the standard OMD update instead of adding stabilization | OMD with dynamic learning rates · Online convex optimization with unbounded Bregman divergence | regret: Ω(T) | Hurt |
| Use dual stabilization with the same decreasing learning rates as dual averaging | OMD · Online convex optimization, strongly convex mirror map | regret: Regret(T, z) ≤ ∑_{t=1}^T η_t ||ĝ_t||_*^2/(2ρ) + D_Φ(z, x_1)/η_{T+1} | No clear effect |
| Use the proximal composite update without linearizing Ψ | Dual-stabilized OMD · Composite online convex optimization | Ψ-regret | Mixed |
Closest papers by meaning
- Online Learning for Structured Loss Spaces (AAAI 2018 · similarity 0.91)
- Delay-Tolerant Online Convex Optimization: Unified Analysis and Adaptive-Gradient Algorithms (AAAI 2016 · similarity 0.90)
- Non-convex online learning via algorithmic equivalence (NeurIPS 2022 · similarity 0.90)
- Mirror Descent Beyond Euclidean Stability: An Exponential Separation in Initialization Sensitivity (NeurIPS 2026 · similarity 0.88)
- Online Composite Optimization Between Stochastic and Adversarial Environments (NeurIPS 2024 · similarity 0.88)
- Revisiting Projection-Free Online Learning with Time-Varying Constraints (AAAI 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
