AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Policy Gradient Methods in the Presence of Symmetries and State Abstractions

Prakash Panangaden, Sahand Rezaei-Shoshtari, Rosie Zhao, David Meger, Doina Precup

JMLR 2024 · Reinforcement learning › Policy gradient and actor-critic · approach: Policy gradients for special settings · 3 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
sum HPG and DPG gradients instead of independent updates (ablation)Deterministic DHPG · DeepMind Control Suite (pixels)gradient varianceImproved
drop the DPG update and use only HPG (ablation)Deterministic DHPG · DeepMind Control Suite, cartpole and pendulumreturnNo clear effect
add the DPG update to HPG (ablation)Deterministic DHPG · DeepMind Control Suite, walkerreturnImproved
use a single critic for actual and abstract MDPs (ablation)Deterministic DHPG · DeepMind Control Suitesample efficiencyMixed
use 3-step instead of 1-step return (ablation)Deterministic DHPG · DeepMind Control Suite with augmentationearly training speedImproved
use 3-step instead of 1-step return (ablation)Deterministic DHPG · DeepMind Control Suite without augmentationfinal performanceHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy