AI Paper Atlas

Research map / Probabilistic and scientific modeling / Molecules and proteins

Quantifying Uncertainty in Random Forests via Confidence Intervals and Hypothesis Tests

Lucas Mentch, Giles Hooker

JMLR 2016 · Probabilistic and scientific modeling › Molecules and proteins · approach: Prediction-powered and conformal inference · 225 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use internal instead of external variance estimate for confidence intervalssubbagged ensemble CIs · SLR and MARS simulationscoverage probability: 0.956 -> 0.936No clear effect
use internal instead of external variance estimate for the feature significance testsubbagged hypothesis test · MARS irrelevant feature X6empirical alpha level: 0 -> 0.14Hurt
increase subsample size k to 200 (from 75) with n=1000subbagged ensemble · MARS simulationnormality of predictions: k=75 -> k=200Hurt
use full bootstrap samples (k = n = 1000) instead of subsamplesensemble · MARS simulationnormality of predictions: k=1000Hurt
estimate zeta_1,k with n_MC=250 instead of larger n_MCexternal variance estimation · SLR and MARS simulationsvariance estimate: n_MC = 250 vs n_MC = 1000Hurt
choose test points in the interior of the feature space rather than near edgeschi-square feature test · MARS simulationfit of test statistics to chi-squareImproved
replace month with random values (ablation)subsampled forest · eBird 2010test statistic vs critical value 31.41: 4233.10 -> 58.02Hurt
add the real month feature versus a random month feature (ablation)subsampled forest · eBird 2010test statistic: 2336.14Improved
replace year with random values (ablation)subsampled forest · eBird 2004-2010test statistic vs critical value 31.41: 94.43 -> 52.51Hurt
add the real year feature versus a random year feature (ablation)subsampled forest · eBird 2004-2010test statistic: 109.72Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy