AI Paper Atlas

Research map / Learning theory and algorithms / Kernels and regression theory

Subspace Fitting Meets Regression: The Effects of Supervision and Orthonormality Constraints on Double Descent of Generalization Errors

Yehuda Dar, Paul Mayer, Lorenzo Luzi, Richard Baraniuk

ICML 2020 · Learning theory and algorithms › Kernels and regression theory · approach: High-dimensional linear regression theory · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Increase the number of input features used for fitting (ablation)Unsupervised PCA subspace fitting · Synthetic subspace-fitting dataout-of-sample reconstruction errorImproved
Increase the estimated subspace rank (ablation)Unsupervised PCA subspace fitting · Synthetic subspace-fitting dataout-of-sample reconstruction errorImproved
Use strict orthonormality constraints instead of unconstrained regression (ablation)Fully supervised subspace fitting · Synthetic supervised subspace-fitting dataout-of-sample squared errorMixed
Remove the orthonormality constraint (ablation)Fully supervised subspace fitting · Synthetic supervised subspace-fitting dataout-of-sample squared errorMixed
Relax orthonormality constraints progressively (ablation)Fully supervised subspace fitting · Synthetic supervised subspace-fitting dataout-of-sample squared errorImproved
Increase the number of supervised examples (ablation)Unconstrained subspace fitting · Synthetic semi-supervised subspace-fitting dataout-of-sample generalization errorMixed
Jointly increase supervision and relax orthonormality constraints (ablation)Subspace fitting along the supervision-orthonormality plane · Synthetic subspace-fitting dataout-of-sample generalization errorMixed
Increase the number of features in unsupervised fitting (ablation)Unsupervised PCA subspace fitting · Synthetic subspace-fitting dataout-of-sample reconstruction errorNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy