AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Model-Free Trajectory Optimization for Reinforcement Learning

Riad Akrour, Gerhard Neumann, Hany Abdulsamad, Abbas Abdolmaleki

ICML 2016 · Reinforcement learning › Policy gradient and actor-critic · approach: Model-based RL with guarantees · 18 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace linearized dynamics model (GPS) with model-free local quadratic Q-function policy update (MOTO)trajectory optimization on multi-link swing-up · quadruple link swing-up with restricted joint limitsaverage returnImproved
Replace linearized dynamics model (GPS) with model-free MOTOtrajectory optimization on double link swing-up · double link swing-up (torque limit 25)average returnImproved
Lower entropy reduction constant beta0 from 0.5 to 0.1 (ablation)MOTO · double link swing-upaverage returnMixed
Add importance sampling sample reuse (ablation)MOTO · double link swing-up (M=20)convergence speedImproved
Add entropy constraint (ablation)MOTO · double link swing-up (M=20)policy quality in last iterationsMixed
Use Monte-Carlo Q estimate instead of dynamic programming estimate (ablation)MOTO · double link swing-up (M=20)policy qualityHurt
Reduce rollouts per iteration from 20 to 5 (with adjusted step size) (ablation)MOTO · double link swing-upsample efficiencyMixed
Use MOTO instead of REPS and MORE for policy update on table tennisrobot table tennis (DMP baselines) · noiseless and varying context table tennisconvergence speedImproved
Use MOTO instead of REPS and MORE on table tennisrobot table tennis · noiseless and varying context table tennisfinal policy returnHurt
Use MOTO's time-dependent linear policy instead of DMP for table tennis with bounce noiserobot table tennis · noisy ball bounceadaptation to noiseImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy