Research map / Learning theory and algorithms / Combinatorial and search optimization
Pruning Random Forests for Prediction on a Budget
Feng Nan, Joseph Wang, Venkatesh Saligrama
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Prune the RF using the global feature-cost and error objective | 40-tree RF · MiniBooNE test | average feature cost: 42.0 -> 24.3 | Improved |
| Prune the RF using the global feature-cost and error objective | 40-tree RF · MiniBooNE test | test error: 6.6% -> 6.7% | Hurt |
| Use feature-cost-aware global pruning instead of CCP | Random forest · MiniBooNE with non-uniform feature costs | cost-accuracy tradeoff | Improved |
| Build the input RF using Pairs impurity rather than entropy (ablation) | BudgetPrune · MiniBooNE and Forest | accuracy | Mixed |
| Build the input RF using Pairs impurity rather than entropy (ablation) | BudgetPrune · MiniBooNE and Forest | accuracy in the low-cost region | Improved |
| Use majority voting instead of aggregating leaf class distributions (ablation) | BudgetPrune · Pruned random forests | prediction error | Hurt |
| Increase the random feature subset size at each split from k=20 to k=120 (ablation) | BudgetPrune input RF · Scene15 | accuracy | Hurt |
Closest papers by meaning
- Randomization as Regularization: A Degrees of Freedom Explanation for Random Forest Success (JMLR 2020 · similarity 0.87)
- Towards Convergence Rate Analysis of Random Forests for Classification (NeurIPS 2020 · similarity 0.87)
- Free Lunch in the Forest: Functionally-Identical Pruning of Boosted Tree Ensembles (AAAI 2025 · similarity 0.85)
- DynFrs: An Efficient Framework for Machine Unlearning in Random Forest (ICLR 2025 · similarity 0.85)
- Minimax Rates and Spectral Distillation for Tree Ensembles (NeurIPS 2026 · similarity 0.85)
- Lightweight Dataset Pruning without Full Training via Example Difficulty and Prediction Uncertainty (ICML 2025 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
