Research map / Optimization / Implicit bias and generalization
On skip connections and normalisation layers in deep optimisation
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Closest papers by meaning
- Skip Connections Eliminate Singularities (ICLR 2018 · similarity 0.88)
- The Shattered Gradients Problem: If resnets are the answer, then what is the question? (ICML 2017 · similarity 0.87)
- Optimization Theory for ReLU Neural Networks Trained with Normalization Layers (ICML 2020 · similarity 0.87)
- The Hidden Convex Optimization Landscape of Regularized Two-Layer ReLU Networks: an Exact Characterization of Optimal Solutions (ICLR 2022 · similarity 0.87)
- Towards Training Without Depth Limits: Batch Normalization Without Gradient Explosion (ICLR 2024 · similarity 0.87)
- On the Weight Dynamics of Deep Normalized Networks (ICML 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.