Research map / Learning theory and algorithms / Prediction and decision losses
Scalable and Efficient Hypothesis Testing with Random Forests
Tim Coleman, Wei Peng, Lucas Mentch
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| increase number of trees B in the permutation test (ablation) | Permutation test (Model 2 simulation) · Model 2 power curves | power and type I error: high power around B 250; level deviates around B 500 | Mixed |
| increase subsample size exponent k_n = n^p (ablation) | Permutation test (Model 2 simulation) · Model 2 power curves | type I error: valid for p <= 0.75, severe deviation above | Hurt |
| use infinitesimal jackknife variance estimate with few trees instead of permutation (ablation) | ranger IJ variance estimate · Model 2, single test point, n=2000 | variance estimate stability: stable only near B = 2000 trees | Hurt |
Closest papers by meaning
- Quantifying Uncertainty in Random Forests via Confidence Intervals and Hypothesis Tests (JMLR 2016 · similarity 0.89)
- Exogenous Randomness Empowering Random Forests (JMLR 2026 · similarity 0.89)
- Randomization as Regularization: A Degrees of Freedom Explanation for Random Forest Success (JMLR 2020 · similarity 0.88)
- DynFrs: An Efficient Framework for Machine Unlearning in Random Forest (ICLR 2025 · similarity 0.86)
- Generalized Random Forests Using Fixed-Point Trees (ICML 2025 · similarity 0.85)
- Statistical Test for Feature Selection Pipelines by Selective Inference (ICML 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
