AI Paper Atlas

Research map / Bandits and online learning / Contextual bandits and Thompson sampling

Profile-Based Bandit with Unknown Profiles

Sylvain Lamprier, Thibault Gisselbrecht, Patrick Gallinari

JMLR 2018 · Bandits and online learning › Contextual bandits and Thompson sampling · approach: Practical contextual bandit extensions · 8 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the profile exploration term (confidence ball on profiles) instead of using empirical sample means as true profiles (ablation)SampLinUCB p=0 · Twitter data capture (USElections, OlympicGames, Brexit)cumulative rewardImproved
add the profile exploration term (confidence ball on profiles) (ablation)SampLinUCB p=0 · Artificial data (K=100, d=5, T=30000)cumulative pseudo-regretImproved
use profile-based SampLinUCB p=0 instead of the best non-contextual policyTwitter data capture · Twitter data capture (non-Sport reward functions)final cumulative reward: between 1.5 and 3 times the best non-contextual approachImproved
use SampLinUCB p=0 instead of CUCBV on the Sport reward functionTwitter data capture · Twitter data capture (Sport reward)cumulative rewardNo clear effect
deliver profile samples for all arms (p=1) instead of only selected arms (p=0) (ablation)SampLinUCB · Twitter data capturefinal cumulative reward: p=0 reaches at least 80% of the reward of p=1Improved
observe profile samples at random for small p (0.005, 0.01) instead of only for selected arms (p=0) (ablation)SampLinUCB · Artificial data (sigma=2.0 and 1.0)cumulative pseudo-regretHurt
use profile-conditioned LinUCB on current samples instead of SampLinUCBLinUCB baseline · Artificial data and Twitter data capturecumulative regret / rewardHurt
lower profile sample variance sigma (2.0 to 0.5) (ablation)SampLinUCB p=0 · Artificial datacumulative pseudo-regretImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy