Research map / Learning theory and algorithms / Kernels and regression theory
Approximate Leave-One-Out for Fast Parameter Tuning in High Dimensions
Shuaiwen Wang, Wenda Zhou, Haihao Lu, Arian Maleki, Vahab Mirrokni
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Approximate leave-one-out risk with ALO instead of fitting once per observation with LOOCV | LASSO · Timing experiments across n=200, 400, 800, 1600 and p=200, 400, 800, 1600 | runtime: $27.52 \pm 0.03$ vs. $0.060 \pm 0.001$ (n=800, p=200); $1249 \pm 3$ vs. $1.20 \pm 0.01$ (n=1600, p=800) | Improved |
| Use ALO to approximate LOOCV risk | LASSO, SVM, fused LASSO, and nuclear norm regression · Risk estimation across the paper's simulation settings | agreement with LOOCV risk estimates | Improved |
| Use ALO for fused LASSO at very small regularization values | Fused LASSO · n<p, dense solutions | agreement with LOOCV risk estimates | Mixed |
Closest papers by meaning
- On Optimal Generalizability in Parametric Learning (NeurIPS 2017 · similarity 0.88)
- A Practical Scheme and Fast Algorithm to Tune the Lasso With Optimality Guarantees (JMLR 2016 · similarity 0.87)
- New Bounds for Hyperparameter Tuning of Regression Problems Across Instances (NeurIPS 2023 · similarity 0.87)
- Bayes beats Cross Validation: Efficient and Accurate Ridge Regression via Expectation Maximization (NeurIPS 2023 · similarity 0.87)
- Provably Data-driven Multiple Hyper-parameter Tuning with Structured Loss Function (ICML 2026 · similarity 0.86)
- SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors (NeurIPS 2024 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
