Research map / Optimization / Optimizers
Mix and Match: An Optimistic Tree-Search Approach for Learning Models from Mixture Distributions
Matthew Faw, Rajat Sen, Karthikeyan Shanmugam, Constantine Caramanis, Sanjay Shakkottai
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Run Mix&Match (random coordinate halving) tree search over mixtures instead of uniform sampling over sources | 3-layer ReLU network · Allstate Purchase Prediction (FL/CT/OH) | test AUROC | Improved |
| Compare Mix&MatchCH against Genie that knows the optimal mixture | Mix&MatchCH · Allstate Purchase Prediction (FL/CT/OH) | test AUROC | No clear effect |
| Train only on the small validation set instead of uniform sampling over sources | 3-layer ReLU network · Allstate Purchase Prediction (FL/CT/OH) | test AUROC | Hurt |
| Use Mix&MatchCH instead of baselines (Uniform, OnlyX, Validation) | 3-layer ReLU network · Amazon Employee Access (new unseen department) | test AUROC | Improved |
| Train only on validation data instead of Mix&Match | 3-layer ReLU network · Amazon Employee Access (new unseen department) | test AUROC | Hurt |
Closest papers by meaning
- MixMin: Finding Data Mixtures via Convex Minimization (ICML 2025 · similarity 0.87)
- Be More Diverse than the Most Diverse: Optimal Mixtures of Generative Models via Mixture-UCB Bandit Algorithms (ICLR 2025 · similarity 0.87)
- Minimax Optimal Early-Stopped Gradient Descent for Gaussian Mixture Classification (NeurIPS 2026 · similarity 0.86)
- Big Learning Expectation Maximization (AAAI 2024 · similarity 0.85)
- Toward Global Convergence of Gradient EM for Over-Paramterized Gaussian Mixture Models (NeurIPS 2024 · similarity 0.85)
- Data Mixture Optimization: A Multi-fidelity Multi-scale Bayesian Framework (NeurIPS 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
