atlas

Research map / Reinforcement learning / Visual and representation RL

Diversify \& Conquer: Outcome-directed Curriculum RL via Out-of-Distribution Disagreement

NeurIPS 2023 · Reinforcement learning › Visual and representation RL · approach: Graph search and compositional goals · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use D2C instead of prior curriculum methodsGoal-conditioned RL · Complex-Maze, Medium-Maze, Spiral-Maze, Ant Locomotion, Sawyer Push, Sawyer Pick&Placeepisode success rateHelped
Use D2C curriculum proposals instead of baseline proposalsCurriculum goal interpolation · Complex-Maze, Medium-Maze, Spiral-Maze, Ant Locomotion, Sawyer Push, Sawyer Pick&Placedistance from curriculum goals to final goalsHelped
Replace the proposed intrinsic reward with sparse reward (ablation)D2C · Sawyer Pushepisode success rateHurt
Remove the curriculum proposal while retaining the intrinsic reward (ablation)D2C · Spiral-Mazeepisode success rateHurt
Vary the number of conditional-classifier prediction heads (ablation)D2C · Spiral-Maze and Sawyer Pushepisode success rateNo clear effect
Vary the auxiliary loss weight λ (ablation)D2C · Spiral-Maze and Sawyer Pushepisode success rateNo clear effect
Add value-function bias to the curriculum objective to reflect temporal distance (ablation)D2C · Complex-Maze, Medium-Maze, Spiral-Maze, Ant Locomotion, Sawyer Push, Sawyer Pick&Placeepisode success rateNo clear effect
Train conditional classifiers using visited states and desired outcomes as goal candidates rather than the target distribution (ablation)D2C · Complex-Maze, Medium-Maze, Spiral-Maze, Ant Locomotion, Sawyer Push, Sawyer Pick&Placeepisode success rateNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy