AI Paper Atlas

Research map / Reinforcement learning / Imitation learning

Generalizable Imitation Learning from Observation via Inferring Goal Proximity

Youngwoon Lee, Andrew Szot, Shao-Hua Sun, Joseph J Lim

NeurIPS 2021 · Reinforcement learning › Imitation learning · approach: Offline imitation from imperfect data · 3 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add uncertainty penalty to GAIfO-s (ablation)GAIfO-s · average over four taskssuccess rate: 18.4%Improved
add goal proximity with difference reward (no uncertainty) (ablation)GAIfO-s · average over four taskssuccess rate: 66.7%Improved
add goal proximity with absolute reward (no uncertainty) (ablation)GAIfO-s · average over four taskssuccess rate: 25.8%Improved
add uncertainty penalty to proximity with difference reward (ablation)Prox+Diff · average over four taskssuccess rate: 66.7% -> 68.7%Improved
add uncertainty penalty to proximity with absolute reward (ablation)Prox+Abs · average over four taskssuccess rate: 25.8% -> 26.4%Improved
use ensemble of discriminators in baseline (ablation)GAIfO-s · average over four taskssuccess rate: 19.6%Improved
apply spectral normalization to discriminator (ablation)GAIfO-s · FETCH PICK 1.75x noisesuccess rate: 1.43% -> 14.56%Improved
replace spectral-normalized baseline with goal proximity methodGAIfO-s · FETCH PICK 1.75x noisesuccess rate: 14.56% -> 75.45%Improved
use absolute instead of difference-based proximity reward (ablation)Ours · ANT REACH and HAND ROTATEsuccess rateMixed
vary uncertainty penalty coefficient away from 0.001 (ablation)Ours · FETCH PICK 1.75xsuccess rateHurt
remove online proximity function update (ablation)Ours · FETCH PICK 1.75xsuccess rateHurt
remove offline pre-training of proximity function (ablation)Ours (No Offline) · FETCH PICK 1.75xtraining speedHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy