atlas

Research map / Reinforcement learning / Visual and representation RL

Interpretable Reward Redistribution in Reinforcement Learning: A Causal Approach

NeurIPS 2023 · Reinforcement learning › Visual and representation RL · approach: In-context and adaptive RL · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use causal reward redistribution and compact state representation instead of the strongest baselineGRD · Half-Cheetahaverage accumulative reward: 1.25 \times 10^4 -> 1.5 \times 10^4Helped
use causal reward redistribution and compact state representation instead of the strongest baselineGRD · Antaverage accumulative reward: 6 \times 10^3 -> 6.5 \times 10^3Helped
use the compact representation instead of all state dimensions as policy input (ablation)GRD · MuJoCo tasksaverage accumulative rewardHelped
increase λ1 from 5e-6 to 5e-5, making the learned reward-causal structure sparser (ablation)GRD · Swimmeraverage accumulative reward: 262± 94(0.66) -> 158± 90(0.17)Hurt
increase λ1 from 0 to 3e-6 (ablation)GRD · Swimmeraverage accumulative reward: 159± 25(0.78) -> 220±102(0.50)Helped
inject Gaussian noise into state dimensions excluded from the compact representation (ablation)GRD · Antevaluation performanceNo clear effect
replace SAC with DDPG or TD3 as the policy-learning backbone (ablation)GRD · Half-Cheetahaverage accumulative rewardHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy