AI Paper Atlas

Research map / Bandits and online learning / Online convex optimization and games

Optimizing Urban Service Allocation with Time-Constrained Restless Bandits

Yi Mao, Andrew Perrault

AAAI 2026 · Bandits and online learning › Online convex optimization and games · approach: Online allocation with constraints

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add Whittle-index lookahead scheduling instead of a reward-oblivious IP scheduler within fixed windows (ablation)RMAB inspection scheduler · Synthetic and CDPH, exactly once per yeartotal rewardImproved
add window optimization on top of schedule optimization (ablation)RMAB inspection scheduler · Synthetic and CDPH, exactly once per yeartotal rewardImproved
optimize windows but keep the reward-oblivious IP scheduler (ablation)RMAB inspection scheduler · Synthetic and CDPH, exactly once per yeartotal rewardHurt
allow some establishments to be inspected twice per year (budget 10-15%) (ablation)(Opt, Opt, [1,2]) · Synthetic and CDPHtotal reward: up to 24% (synthetic), 33% (CDPH)Improved
raise inspection budget from 12% to 15% (ablation)(Opt, Opt, [1,2]) on CDPH · CDPHtotal rewardNo clear effect
add Gaussian noise to transition parameters, using Opt-Opt instead of Opt-IP(Opt, Opt, =1) · Synthetic robustnessreward change: -83.69 vs -101.14 at N(0, 0.05)Improved
add 1% surprise inspections with window and schedule optimization(Opt, Opt, =1) · Syntheticreward loss: 2.6% -> 1.9%Improved
train neural net on transition probabilities instead of predicting failures with XGBoostinspection failure prediction · CDPH dataAUC: 0.67 -> 0.75Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy