Research map / Learning theory and algorithms / Prediction and decision losses
MERCS: Multi-Directional Ensembles of Regression and Classification Trees
Elia Van Wolputte, Evgeniya Korneva, Hendrik Blockeel
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use multi-target trees (p in 2..10) instead of single-target trees (p=1) (ablation) | MERCS · 11 density-estimation datasets (e.g. voting, msnbc) | model induction time | Improved |
| use multi-target trees instead of single-target trees (ablation) | MERCS · 11 datasets | macro F1 per query | No clear effect |
| MA-prediction instead of MI-prediction with random selection strategy (ablation) | MERCS · datasets with random tree selection | macro F1 per query | Improved |
| MA-prediction instead of MI-prediction with default selection strategy (ablation) | MERCS · datasets with default selection | macro F1 per query | No clear effect |
| MERCS instead of PGM (BayesFusion) | MERCS vs BayesFusion · nominal datasets | inference time per query: up to about 3 orders of magnitude faster | Improved |
| MERCS instead of PGM (BayesFusion) | MERCS vs BayesFusion · datasets with many attributes (voting) | induction time | Mixed |
| MERCS instead of PGM (BayesFusion) | MERCS vs BayesFusion · 12 datasets | macro F1 per query: loses in 7 cases, wins in 5 | Mixed |
Closest papers by meaning
- Smaller, more accurate regression forests using tree alternating optimization (ICML 2020 · similarity 0.86)
- Piecewise Constant and Linear Regression Trees: An Optimal Dynamic Programming Approach (ICML 2024 · similarity 0.85)
- GRANDE: Gradient-Based Decision Tree Ensembles for Tabular Data (ICLR 2024 · similarity 0.84)
- Learning Decision Trees and Forests with Algorithmic Recourse (ICML 2024 · similarity 0.84)
- Learning Small Decision Trees with Few Outliers: A Parameterized Perspective (AAAI 2024 · similarity 0.84)
- Minimax Rates and Spectral Distillation for Tree Ensembles (NeurIPS 2026 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
