Research map / Label-efficient and robust learning / Recognition and long-tail
A Unified Theory of Diversity in Ensemble Learning
Danny Wood, Tingting Mu, Andrew M. Webb, Henry W. J. Reeve, Mikel Luján, Gavin Brown
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add split-point randomisation (Random Forest instead of Bagging) | decision tree ensemble (m=20) · MNIST | generalisation error reduction: 9 -> 14.5 (approx. % reduction) | Improved |
| use unconstrained depth trees instead of depth 8 in Bagging | Bagging, 30 trees · California Housing | MSE: 0.35 -> 0.30 | Improved |
| use Random Forest instead of unconstrained Bagging | 30 trees · California Housing | MSE: 0.30 -> 0.28 | Improved |
| bag 30 trees instead of a single depth-8 tree | depth 8 regression tree · California Housing | MSE: 0.47 -> 0.35 | Improved |
| increase ensemble size m with fixed base learner capacity | Bagged depth 8 regression trees · California Housing | expected risk | Improved |
| increase tree depth at fixed m=10 | Bagged regression trees · California Housing | bias, variance, diversity | Mixed |
| use larger MLPs (100 hidden) instead of small (20 hidden) in Bagging | Bagged MLPs · MNIST | ensemble cross-entropy | Improved |
| use Random Forest instead of Bagging with growing ensemble size | MNIST tree ensembles · MNIST | 0/1 risk | Mixed |
Closest papers by meaning
- Ensembles of Locally Independent Prediction Models (AAAI 2020 · similarity 0.91)
- Diversity Matters When Learning From Ensembles (NeurIPS 2021 · similarity 0.90)
- On the Diversity of Adversarial Ensemble Learning (ICML 2025 · similarity 0.90)
- Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance (NeurIPS 2024 · similarity 0.89)
- Boosting Ensemble Accuracy by Revisiting Ensemble Diversity Metrics (CVPR 2021 · similarity 0.89)
- Diverse Prototypical Ensembles Improve Robustness to Subpopulation Shift (ICML 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
