Research map / Reinforcement learning / Policy gradient and actor-critic
Learning Robust Options
Daniel Mankowitz, Timothy Mann, Pierre-Luc Bacon, Doina Precup, Shie Mannor
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add option heads with alternating online optimization | DQN · CartPole and Acrobot | task performance | Improved |
| Add option heads with alternating online optimization | DQN · CartPole and Acrobot with changed dynamics | task performance | Mixed |
| Add robust TD updates to option learning | Option DQN · CartPole and Acrobot across parameter settings | average reward | Improved |
| Add ASAP options with coarse option partitions | Limited-representation actor-critic · CartPole across pole lengths 0.5–5.0 m | task performance | Improved |
| Use a coarse feature representation and option partitions (ablation) | Linear ASAP · CartPole across pole lengths 0.5–5.0 m | robustness to model uncertainty | Improved |
| Use options instead of the limited policy representation alone | Linear actor-critic · CartPole | task performance | Improved |
Closest papers by meaning
- Combining Pessimism with Optimism for Robust and Efficient Model-Based Deep Reinforcement Learning (ICML 2021 · similarity 0.89)
- Robust Offline Reinforcement Learning with Linearly Structured $f$-Divergence Regularization (ICML 2025 · similarity 0.89)
- Adversarial Diffusion for Robust Reinforcement Learning (NeurIPS 2025 · similarity 0.89)
- Model-Free Robust $\phi$-Divergence Reinforcement Learning Using Both Offline and Online Data (ICML 2024 · similarity 0.87)
- Time-Constrained Robust MDPs (NeurIPS 2024 · similarity 0.87)
- Improve Robustness of Reinforcement Learning against Observation Perturbations via l∞ Lipschitz Policy Networks (AAAI 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
