AI Paper Atlas

Research map / Learning theory and algorithms / Kernels and regression theory

ENNS: Variable Selection, Regression, Classification, and Deep Neural Network for High-Dimensional Data

Kaixu Yang, Arkaprabha Ganguli, Tapabrata Maiti

JMLR 2024 · Learning theory and algorithms › Kernels and regression theory · approach: Double descent and overfitting

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use ENNS ensemble selection instead of pure stage-wise DNPDNP · Simulation regression, s=10false positive rate: 41.4% -> 12.8%Improved
use ENNS ensemble selection instead of pure stage-wise DNPDNP · Simulation classification, s=10false positive rate: 40.5% -> 9.8%Improved
use ENNS ensemble selection instead of pure stage-wise DNPDNP · Simulation regression, s=2false positive rate: 22.5% -> 10.4%Improved
use ENNS instead of DNP for selection (low signal)DNP · Simulation classification, s=10avg correct variables selected: 5.95 -> 8.04Improved
use ENNS instead of LASSO for selection (low signal)LASSO · Simulation regression, s=10avg correct variables selected: 9.62 -> 9.25No clear effect
use ENNS instead of HSIC-LASSO for selection (low signal)HSIC-LASSO · Simulation classification, s=10avg correct variables selected: 3.61 -> 8.04Improved
raise signal strength from normal to highENNS · Simulation classification, s=10avg correct variables selected: 8.38 -> 9.90Improved
raise signal strength from normal to highHSIC-LASSO · Simulation classification, s=10avg correct variables selected: 4.95 -> 7.76Improved
use ENNS + l1 neural network instead of LASSO linear modelLASSO · Riboflavintest MSE: 0.286 -> 0.268Improved
use ENNS + l1 neural network instead of regularized neural networkRegularized neural network · Prostate cancertest accuracy: 0.955 -> 0.956No clear effect
use ENNS + l1 neural network instead of GAM with group lassoGAM with group lasso · Prostate cancertest accuracy: 0.918 -> 0.956Improved
add more correct variables already in the stage-wise model (0 to 4)stage-wise neural network selection · Linear regression simulationprobability next variable correct: 0.995 -> 0.430Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy