Research map / Optimization / Implicit bias and generalization
Elastic Gradient Descent, an Iterative Optimization Method Approximating the Solution Paths of the Elastic Net
Oskar Allerbo, Johan Jonasson, Rebecka Jörnsten
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add momentum (gamma=0.5) to elastic gradient descent (ablation) | EGD · Twitter Popularity (291624x77) | execution time in seconds: 48 -> 6.0 | Improved |
| add momentum (gamma=0.5) to elastic gradient descent (ablation) | EGD · Twitter Popularity (291624x77) | model size: 60 -> 27 | Improved |
| add momentum (gamma=0.5) to elastic gradient descent (ablation) | EGD · Superconductors (21263x81) | test R2: 0.70 -> 0.66 | Hurt |
| add momentum (gamma=0.5) to elastic gradient descent (ablation) | EGD · English Readability (2834x768) | model size: 105 -> 115 | Hurt |
| use elastic gradient descent instead of the elastic net path | elastic net · Twitter Popularity (291624x77) | execution time in seconds: 5100 -> 48 | Improved |
| use elastic gradient descent instead of the elastic net path | elastic net · Superconductors (21263x81) | execution time in seconds: 340 -> 2.6 | Improved |
| use elastic gradient descent instead of coordinate descent | coordinate descent · Protein Structure (45730x9) | test R2: 0.15 -> 0.24 | Improved |
| use elastic gradient descent instead of coordinate descent | coordinate descent · English Readability (2834x768) | test R2: 0.58 -> 0.69 | Improved |
| use elastic gradient descent instead of the elastic net | elastic net · Diabetes (alpha=0.3) | number of models along path: 10 -> 3 | Improved |
| use elastic gradient descent instead of the elastic net | elastic net · Diabetes (alpha=0.7) | number of models along path: 11 -> 7 | Improved |
| add momentum to elastic gradient descent for p>n (ablation) | EGD · synthetic two-block data (p>n=100) | specificity | Improved |
| keep number of non-zero parameters constant at 40 as p grows (ablation) | EGD with momentum · synthetic two-block data | specificity | No clear effect |
Closest papers by meaning
- Provably tuning the ElasticNet across instances (NeurIPS 2022 · similarity 0.90)
- Accelerating Rescaled Gradient Descent: Fast Optimization of Smooth Functions (NeurIPS 2019 · similarity 0.87)
- Implicit Sparse Regularization: The Impact of Depth and Early Stopping (NeurIPS 2021 · similarity 0.87)
- Directional Smoothness and Gradient Methods: Convergence and Adaptivity (NeurIPS 2024 · similarity 0.86)
- Implicit Regularization of Decentralized Gradient Descent for Sparse Regression (NeurIPS 2024 · similarity 0.85)
- Enhanced Cyclic Coordinate Descent Methods for Elastic Net Penalized Linear Models (NeurIPS 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
