Research map / Optimization / Implicit bias and generalization

Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data

NeurIPS 2023 · Optimization › Implicit bias and generalization · approach: Implicit bias in linear networks · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Closest papers by meaning

• Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data (ICLR 2023 · similarity 0.97)
• Can Implicit Bias Imply Adversarial Robustness? (ICML 2024 · similarity 0.90)
• Implicit Bias of Gradient Descent for Non-Homogeneous Deep Networks (ICML 2025 · similarity 0.90)
• Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks (ICLR 2025 · similarity 0.90)
• Implicit Bias of Mirror Flow for Shallow Neural Networks in Univariate Regression (ICLR 2025 · similarity 0.89)
• The Implicit Bias of Gradient Descent toward Collaboration between Layers: A Dynamic Analysis of Multilayer Perceptions (NeurIPS 2024 · similarity 0.88)