AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

Breadcrumbs to the Goal: Goal-Conditioned Exploration from Human-in-the-Loop Feedback

Marcel Torne Villasevil, Max Balsells I Pamies, Zihan Wang, Samedh Desai, Tao Chen, Pulkit Agrawal, Abhishek Gupta

NeurIPS 2023 · Reinforcement learning › Visual and representation RL · approach: Goal-conditioned policy learning · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
learn a parametric goal selector instead of directly using human-selected goals (DDL) (ablation)HuGE · simulated goal-reaching benchmarkshuman annotations needed: 50% less human annotationsImproved
pretrain with 5 noisy trajectories (BC + Ours)HuGE · simulated goal-reaching benchmarkstimesteps to successImproved
guide exploration with learned goal selector instead of indiscriminate exploration (LEXA)HuGE · simulated goal-reaching benchmarkssuccessImproved
use human feedback to bias exploration instead of learning a reward function (Human Preferences)HuGE · simulated goal-reaching benchmarkssuccessImproved
add large amounts of noise to human annotations (ablation)HuGE · simulated goal-reaching benchmarksconvergence to optimal solutionNo clear effect
query for human labels more frequently (ablation)HuGE · simulated goal-reaching benchmarkslabels needed vs timesteps to successMixed
use real crowdsourced human feedback instead of synthetic labelsHuGE · kitchen environmentsuccessImproved
use dense reward PPO instead of HuGEPPO · simulated goal-reaching benchmarkssuccessHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy