Research map / Optimization / Optimizers
New Insights and Perspectives on the Natural Gradient Method
James Martens
Read the paperCheck your idea against 137,217 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- Limitations of the empirical Fisher approximation for natural gradient descent (NeurIPS 2019 · similarity 0.91)
- Energetic Natural Gradient Descent (ICML 2016 · similarity 0.90)
- Natural Hypergradient Descent: Algorithm Design, Convergence Analysis, and Parallel Implementation (ICML 2026 · similarity 0.89)
- Spectral Preconditioning for Gradient Methods on Graded Non-convex Functions (ICML 2024 · similarity 0.87)
- A Layer-Wise Natural Gradient Optimizer for Training Deep Neural Networks (NeurIPS 2024 · similarity 0.87)
- Advancing the Lower Bounds: an Accelerated, Stochastic, Second-order Method with Optimal Adaptation to Inexactness (ICLR 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
