Research map / Optimization / Implicit bias and generalization
Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- Theoretical Analysis of Auto Rate-Tuning by Batch Normalization (ICLR 2019 · similarity 0.90)
- An Exponential Learning Rate Schedule for Deep Learning (ICLR 2020 · similarity 0.89)
- On the Generalization Benefit of Noise in Stochastic Gradient Descent (ICML 2020 · similarity 0.88)
- On the Weight Dynamics of Deep Normalized Networks (ICML 2024 · similarity 0.87)
- Coherent Gradients: An Approach to Understanding Generalization in Gradient Descent-based Optimization (ICLR 2020 · similarity 0.87)
- Normalization and effective learning rates in reinforcement learning (NeurIPS 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.