atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Continuous-time Model-based Reinforcement Learning

ICML 2021 · Reinforcement learning › Policy gradient and actor-critic · approach: Off-policy actor-critic with expressive policies · 9 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use continuous-time ENODE dynamics instead of modified PETSModel-based RL on noisy Pendulum, CartPole, and Acrobot · Pendulum, CartPole, Acrobot; noisy data with varied observation spacingrewardMixed
Use modified PETS, which includes the time increment as an input, instead of vanilla PETSPETS dynamics model · CartPole; irregularly sampled observationsone-step prediction errorHelped
Use ENODE rather than discrete-time modelsModel-based RL on Pendulum, CartPole, and Acrobot · Pendulum, CartPole, Acrobot; noise-free regularly sampled observationsrewardNo clear effect
Use Deep PILCO rather than the proposed model variantsModel-based RL · Pendulum, CartPole, Acrobot; noise-free regularly sampled observationsrounds to solveHurt
Use shorter or longer imagination horizons instead of an intermediate horizon (ablation)ENODE · CartPole; noise-free data with fixed observation intervalsrewardHurt
Vary the number of ensemble members (ablation)ENODE · CartPole; noise-free data with fixed observation intervalsrewardNo clear effect
Add observation noiseENODE and modified PETS · Pendulum, CartPole, Acrobotrounds to solveHurt
Reduce the mean observation time differenceModified PETS · Pendulum, CartPole, Acrobot; noisy datarewardHurt
Use stochastic rather than fixed observation-time incrementsENODE and modified PETS · Pendulum, CartPole, Acrobot; noisy datarewardNo clear effect
Use continuous-time trajectory integration rather than discrete transitionsCartPole control simulation · CartPolestate-solution errorHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy