AI Paper Atlas

Research map / Reinforcement learning / Imitation learning

SafeDICE: Offline Safe Imitation Learning with Non-Preferred Demonstrations

Youngsoo Jang, Geon-Hyeong Kim, Jongmin Lee, Sungryull Sohn, Byoungjip Kim, Honglak Lee, Moontae Lee

NeurIPS 2023 · Reinforcement learning › Imitation learning · approach: Offline imitation from imperfect data · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use SafeDICE instead of BC, DWBC, PPL, DExperts on safety metricsSafeDICE · RWRL Cartpole, Walker, QuadrupedAverage Cost, Cost-Violating Ratio, CVaR 10% CostImproved
Use SafeDICE on Cartpole for worst-case costSafeDICE · RWRL CartpoleCVaR 10% CostNo clear effect
Use SafeDICE instead of baselines on returnSafeDICE · RWRL tasksNormalized ReturnNo clear effect
Use SafeDICE instead of baselinesSafeDICE · Safety Gym Goal and Buttonsafety metricsImproved
Use SafeDICE on Button taskSafeDICE · Safety Gym ButtonReturnHurt
Use preference-based PPL instead of BCBC · RWRL Walker and Quadruped vs CartpolesafetyMixed
Reduce labeled non-preferred demonstrations |DN| from 50 to 5 (ablation)SafeDICE and baselines · RWRL Walkersafety metricsMixed
Vary alpha over 0 to 0.8 instead of theoretically determined alpha (Eq. 15) (ablation)SafeDICE · RWRL WalkerCVaR costHurt
Remove stationary distribution constraint (ablation)SafeDICE · RWRL Walkercost violation, CVaR 10% CostHurt
Remove labeled non-preferred demonstrations (ablation)SafeDICE · RWRL Walkercost violation, CVaR 10% CostHurt
Vary ratio of preferred to non-preferred in unlabeled data, from (250, 1000) to (1000, 250) (ablation)SafeDICE · RWRL Walkercost violationNo clear effect
Tune eta and alpha of DWBC and DExperts over 0.01 to 0.8 (ablation)DWBC, DExperts · RWRL WalkersafetyMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy