AI Paper Atlas

Research map / Large language models / Alignment and preferences

Personalized Reward Learning with Interaction-Grounded Learning (IGL)

ICLR 2023 · Large language models › Alignment and preferences · approach: Reward model design and preference models · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use three latent reward states instead of two (ablation)IGL-P · Production image recommendationDislikes: [1.141, 1.337, 1.557] -> [0.751, 1.072, 1.274]Helped
Use three latent reward states instead of two (ablation)IGL-P · Production image recommendationLikes: [0.914, 0.949, 0.988] -> [0.985, 1.029, 1.054]Helped
Use three latent reward states instead of two (ablation)IGL-P · Three-state recommendation simulatoruser satisfactionHelped
Use IGL-P(2) rather than IGL-P(3) (ablation)IGL-P · Two-state recommendation simulatoruser satisfactionNo clear effect
Add a definitely-negative feedback oracle to disambiguate negative reward events (ablation)IGL-P(3) · Three-state recommendation simulatoruser satisfactionHelped
Use IGL-P(3) instead of CB-ClickProduction image recommendation · Production image recommendationDislikes: [1.234, 1.311, 1.348] -> [0.890, 0.918, 0.955]Helped
Use IGL-P(3) instead of CB-ClickProduction image recommendation · Production image recommendationClicks: [0.968, 0.979, 0.990] -> [1.000, 1.010, 1.020]Helped
Optimize comments as the reward instead of personalized latent satisfactionCB-comment · Facebook news recommendationuser dissatisfactionMixed
Personalize reward learning across reader communication stylesIGL-P(3) · Facebook news recommendationrecommendation performance across reader groupsHelped
Optimize emoji reactions as a fixed rewardCB-emoji · Facebook news recommendationnegative rewardHurt
Reduce the frequency of definitely-negative dislike feedback (ablation)IGL-P(3) · Three-state recommendation simulatorconvergence speedHurt
Use IGL-P(2) when the underlying environment has three latent reward states (ablation)IGL-P · Three-state recommendation simulatoruser satisfactionHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy