AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Generalized Off-Policy Actor-Critic

Shangtong Zhang, Wendelin Boehmer, Shimon Whiteson

NeurIPS 2019 · Reinforcement learning › Policy gradient and actor-critic · approach: Actor-critic theory · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Optimize the counterfactual objective with Geoff-PAC instead of the excursion objective with ACETwo-circle MDP · Two-circle MDPtarget-policy solutionImproved
Increase the counterfactualness parameter hat-gamma (ablation)Geoff-PAC · Two-circle MDPfinal solutionMixed
Vary lambda_2 (ablation)Geoff-PAC · Two-circle MDPfinal solutionNo clear effect
Use Geoff-PAC instead of ACE or Off-PACOff-PAC and ACE · Mujoco robot simulation tasksJ_piMixed
Use Geoff-PAC instead of DDPGDDPG · Hopper and SwimmerJ_piImproved
Use Geoff-PAC instead of TD3TD3 · Hopper and SwimmerJ_piImproved
Use a uniformly random behavior policy with DDPGDDPG · HalfCheetah, Walker, and HopperJ_piHurt
Vary lambda_1 (ablation)ACE · HalfCheetahperformanceNo clear effect
Use lambda_1 = 0.7, lambda_2 = 0.6, and hat-gamma = 0.2 (ablation)Geoff-PAC · HalfCheetahperformanceImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy