Research map / Learning theory and algorithms / Sample complexity
A/B/n Testing with Control in the Presence of Subpopulations
Yoan Russac, Christina Katsimerou, Dennis Bohle, Olivier Cappé, Aurélien Garivier, Wouter M Koolen
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use adaptive sampling (T-a-S active) instead of uniform sampling | T-a-S · Synthetic Bernoulli bandits | average stopping time: 21586 -> 14871 | Improved |
| use proportional mode instead of active mode (ablation) | T-a-S · Synthetic Bernoulli bandits | average stopping time: 14871 -> 15231 | Hurt |
| use agnostic mode instead of active mode (ablation) | T-a-S · Synthetic Bernoulli bandits | average stopping time: 14871 -> 15444 | Hurt |
| use T-a-S (agnostic) instead of BC-ABC heuristic | sampling rule · Synthetic Bernoulli bandits | average stopping time: 15279 -> 15444 | No clear effect |
| give the learner control over which subpopulation is sampled (active mode) (ablation) | T-a-S · Specific model with alpha != beta | expected samples to identify solution | Improved |
| proportional vs agnostic interaction mode (ablation) | T-a-S · Specific model with alpha != beta | expected samples to identify solution | No clear effect |
| adaptive T-a-S instead of uniform sampling | A/B/n web experiment · Real A/B/n data | risk assessment at budget end: 0.67 -> 0.1 | Improved |
| active instead of passive interaction modes (ablation) | T-a-S · Real A/B/n data | stopping time | Improved |
Closest papers by meaning
- Strategic A/B testing via Maximum Probability-driven Two-armed Bandit (ICML 2025 · similarity 0.87)
- On Universally Optimal Algorithms for A/B Testing (ICML 2024 · similarity 0.85)
- Asymptotically Optimal and Computationally Efficient Average Treatment Effect Estimation in A/B testing (ICML 2024 · similarity 0.84)
- Just Ramp-Up: Debiasing Regression-based Estimator for A/B Tests under Network Interference (NeurIPS 2026 · similarity 0.83)
- Simulation-Based Inference for Adaptive Experiments (NeurIPS 2025 · similarity 0.82)
- Performance Bounds for Active Binary Testing with Information Maximization (ICML 2024 · similarity 0.82)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
