AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

Regularity as Intrinsic Reward for Free Play

Cansu Sancaktar, Justus Piater, Georg Martius

NeurIPS 2023 · Reinforcement learning › Visual and representation RL · approach: Reward shaping for sparse rewards · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add RaIR regularity reward to CEE-US ensemble disagreement (lambda=0.1) (ablation)CEE-US · Construction Singletower 3zero-shot success rate: 0.40 ± 0.12 -> 0.75 ± 0.07Improved
add RaIR regularity reward to CEE-US ensemble disagreement (lambda=0.1) (ablation)CEE-US · Construction Pyramid 6zero-shot success rate: 0.02 ± 0.01 -> 0.18 ± 0.04Improved
add RaIR regularity reward to CEE-US ensemble disagreement (lambda=0.1) (ablation)CEE-US · Construction Multitower 2+2zero-shot success rate: 0.52 ± 0.05 -> 0.77 ± 0.06Improved
add RaIR to CEE-US (ablation)CEE-US · Construction Pick&Place 6zero-shot success rate: 0.90 ± 0.02 -> 0.90 ± 0.02No clear effect
add RaIR to CEE-US (ablation)CEE-US · Construction Throw 4zero-shot success rate: 0.49 ± 0.05 -> 0.32 ± 0.02Hurt
add RaIR to CEE-US (ablation)CEE-US · Construction Flip 4zero-shot success rate: 0.73 ± 0.1 -> 0.63 ± 0.08Hurt
remove ensemble disagreement term (pure RaIR, lambda=0) (ablation)RaIR + CEE-US · Construction Pyramid 5zero-shot success rate: 0.49 ± 0.06 -> 0.25 ± 0.05Hurt
remove ensemble disagreement term (pure RaIR, lambda=0) (ablation)RaIR + CEE-US · Construction Pick&Place 6zero-shot success rate: 0.90 ± 0.02 -> 0.74 ± 0.05Hurt
remove ensemble disagreement term (pure RaIR, lambda=0) (ablation)RaIR + CEE-US · Construction Flip 4zero-shot success rate: 0.63 ± 0.08 -> 0.65 ± 0.1No clear effect
use relative phi instead of absolute relative phi (ablation)RaIR + CEE-US · Construction assembly taskszero-shot success rate: 0.75 ± 0.07 -> 0.80 ± 0.07No clear effect
increase lambda to 1 (more weight on ensemble disagreement) (ablation)RaIR + CEE-US · Construction free play interactionsinteraction metricsHurt
use controller mode best instead of sum for free play (ablation)CEE-US · Construction Singletower 3zero-shot success rate: 0.26 ± 0.11 -> 0.40 ± 0.12Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy