AI Paper Atlas

Research map / Probabilistic and scientific modeling / Molecules and proteins

From Predictions to Decisions: Using Lookahead Regularization

Nir Rosenfeld, Anna Hilgard, Sai Srivatsa Ravindranath, David C. Parkes

NeurIPS 2020 · Probabilistic and scientific modeling › Molecules and proteins · approach: Statistical analysis of ML practice

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add lookahead regularization (small step size)quadratic regression · Quadratic curves, eta=0.75mean improvement magnitude: 1.109 -> 1.108No clear effect
add lookahead regularization (moderate step size)quadratic regression · Quadratic curves, eta=1.25mean improvement rate: 0.143 -> 0.714Improved
add lookahead regularization (moderate step size)quadratic regression · Quadratic curves, eta=1.25RMSE: 0.342 -> 0.424Hurt
add lookahead regularization (moderate step size)quadratic regression · Quadratic curves, eta=1.25mean improvement magnitude: -0.261 -> 1.065Improved
add lookahead regularization (very large step size)quadratic regression · Quadratic curves, eta=3.5mean improvement magnitude: -35.13 -> 0.604Mixed
increase lookahead lambda under full mutabilitylinear model · Wine quality, all features mutable (eta=0.5)improvement vs RMSEMixed
increase ridge alpha for baselinelinear ridge model · Wine quality, full mutabilityimprovementHurt
increase lookahead lambda under partial mutabilitylinear model · Wine quality, partial mutability (eta=2)improvement with RMSEImproved
use lookahead instead of baseline under partial mutabilitylinear model · Wine quality, partial mutabilityimprovement rate: ~40% -> 100%Improved
add lookahead on diabetes with linear f and bootstrapped glinear model · Diabetes, BMI and s1 mutable (eta=5)improvement rate and magnitude with accuracyImproved
use quadratic f with quantile regression uncertaintyquadratic model · Diabetes non-linear settingindividualized decisions toward low uncertaintyImproved
lookahead regularization when x' moves far from the sample distribution (eta=3.5)lookahead model · Quadratic curves, eta=3.5mean improvement rate: 0 -> 0.571Mixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy