Research map / Optimization / Optimizers
Cautious Optimizers: Improving Training with One Line of Code
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- Lion Secretly Solves a Constrained Optimization: As Lyapunov Predicts (ICLR 2024 · similarity 0.85)
- Taming Transformer Without Using Learning Rate Warmup (ICLR 2025 · similarity 0.84)
- Delve into the Applicability of Advanced Optimizers for Multi-Task Learning (NeurIPS 2026 · similarity 0.84)
- A geometric framework for momentum-based optimizers for low-rank training (NeurIPS 2025 · similarity 0.84)
- Enhancing Optimizer Stability: Momentum Adaptation of The NGN Step-size (NeurIPS 2025 · similarity 0.84)
- MGUP: A Momentum-Gradient Alignment Update Policy for Stochastic Optimization (NeurIPS 2025 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.