Research map / Reinforcement learning / Visual and representation RL
Hierarchical Reinforcement Learning with Timed Subgoals
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use timed subgoals with time-interval conditioning (HiTS) instead of HAC | two-level hierarchy · Platforms | success rate: 40% -> 86% | Helped |
| augment HAC observation and subgoal space with absolute time (ablation) | HAC · Platforms | success rate | Hurt |
| HiTS vs HAC and SAC on Tennis2D | two-level hierarchy · Tennis2D | success rate: around 40% within 20 million steps | Helped |
| HiTS vs HAC on static benchmarks (UR5Reacher, AntFourRooms, Pendulum) | two-level hierarchy · static sparse-reward tasks | success rate | Mixed |
| increase timed subgoal budget (HiTS) (ablation) | HiTS · Platforms | success rate | Mixed |
| increase subgoal budget (HAC) (ablation) | HAC · Platforms | success rate: stagnates at around 50% | No clear effect |
| HiTS vs SAC and HAC on Ball in cup | HiTS · Ball in cup | return / speed | Helped |
Closest papers by meaning
- Data-Efficient Hierarchical Reinforcement Learning (NeurIPS 2018 · similarity 0.90)
- On Efficiency in Hierarchical Reinforcement Learning (NeurIPS 2020 · similarity 0.90)
- Hierarchical Reinforcement Learning with Targeted Causal Interventions (ICML 2025 · similarity 0.90)
- Learning Subgoal Representations with Slow Dynamics (ICLR 2021 · similarity 0.90)
- Hierarchical Reinforcement Learning with Uncertainty-Guided Diffusional Subgoals (ICML 2025 · similarity 0.89)
- Probabilistic Subgoal Representations for Hierarchical Reinforcement Learning (ICML 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.