AI Paper Atlas

Research map / Reinforcement learning / Imitation learning

Generative Adversarial Post-Training Mitigates Reward Hacking in Live Human-AI Music Interaction

Yusong Wu, Stephen Brade, Teng Ma, Tia-Jane Fowler, Enning Yang, Berker Banar, Aaron Courville, Natasha Jaques, Cheng-Zhi Anna Huang

ICLR 2026 · Reinforcement learning › Imitation learning · approach: Adversarial imitation learning · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add adversarial reward to RL post-training (PPO) (ablation)GAPT · fixed-melody test setdiversity (Vendi): 20.814 -> 26.645Improved
add adversarial reward to RL post-training (PPO) (ablation)GAPT · fixed-melody test setharmony: 0.476 -> 0.497Improved
add adversarial reward to RL post-training (PPO) (ablation)GAPT · out-of-distribution Wikifoniadiversity (Vendi): 8.034 -> 11.295Improved
add adversarial training to GRPO (ablation)GRPO · fixed-melody test setdiversity (Vendi): 16.872 -> 26.603Improved
add adversarial training to GRPO (ablation)GRPO · fixed-melody test setharmony: 0.459 -> 0.478Improved
discriminator conditioned on melody and chord instead of chord only (ablation)GAPT · fixed-melody test setdiversity (Vendi): 26.645 -> 23.545Hurt
upweight rule penalties (beta=2) (ablation)GAPT · fixed-melody test setharmony and diversity: 0.497 -> 0.475; 26.645 -> 25.667Hurt
upweight coherence reward (alpha=2) (ablation)GAPT · fixed-melody test setharmony and diversity: 0.497 -> 0.494; 26.645 -> 26.742No clear effect
upweight adversarial reward (gamma=2) (ablation)GAPT · fixed-melody test setharmony: 0.497 -> 0.456Hurt
remove rule-based penalties entirely (ablation)GAPT · fixed-melody test setharmony and diversityHurt
replace Online MLE by GAPT as accompaniment policylive jamming with musicians · user study (12 musicians)adaptation speed and control/agency ratings: p<0.05 vs ReaLchordsImproved
use GAPT instead of Online MLE with a learned melody agentGAPT · learned melody agentharmony and diversity: diversity 18.071 -> 12.914Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy