Research map / Optimization / Implicit bias and generalization
On the Local Hessian in Back-propagation
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace vanilla SGD with scale-amended SGD (per-block gradient rescaling by scalar local Hessian approximation) | VGG13 with BN · CIFAR-10 | test error | Helped |
| replace vanilla SGD with scale-amended SGD (per-block gradient rescaling by scalar local Hessian approximation) | VGG13 with BN · CIFAR-100 | test error | Helped |
Closest papers by meaning
- meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting (ICML 2017 · similarity 0.87)
- BP-Modified Local Loss for Efficient Training of Deep Neural Networks (ICLR 2025 · similarity 0.87)
- Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation (ICML 2024 · similarity 0.87)
- Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation (ICLR 2025 · similarity 0.86)
- Investigating the Overlooked Hessian Structure: From CNNs to LLMs (ICML 2025 · similarity 0.86)
- Accelerated training through iterative gradient propagation along the residual path (ICLR 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.