Research map / Learning theory and algorithms / Prediction and decision losses
Agree to Disagree: Demystifying Homogeneous Deep Ensembles through Distributional Equivalence
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Analyzes why homogeneous deep ensembles improve performance by framing ensemble members through distributional equivalence, rather than relying only on Jensen gap explanations.
Problem
The origin of performance gains from deep ensembles is poorly understood; existing studies attribute them to Jensen gaps of the ensemble loss.
Approach
Proposes a distributional-equivalence view of homogeneous deep ensembles to explain their improvement, going beyond the Jensen-gap explanation prevalent in prior work.
Closest papers by meaning
- Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance (NeurIPS 2024 · similarity 0.88)
- The Disparate Benefits of Deep Ensembles (ICML 2025 · similarity 0.88)
- Theoretical Limitations of Ensembles in the Age of Overparameterization (ICML 2025 · similarity 0.86)
- No Free Lunch from Random Feature Ensembles: Scaling Laws and Near-Optimality Conditions (ICML 2025 · similarity 0.85)
- Ensemble Pruning for Out-of-distribution Generalization (ICML 2024 · similarity 0.85)
- Emergent Equivariance in Deep Ensembles (ICML 2024 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
