Research map / Reinforcement learning / Visual and representation RL
There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learning
Nathan Grinsztajn, Johan Ferret, Olivier Pietquin, Philippe Preux, Matthieu Geist
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add reversibility-aware exploration (RAE) intrinsic reward penalizing irreversibility, with no extrinsic reward | PPO · reward-free Cartpole | episode score | Improved |
| add RAE to the agent | PPO · Turf | path chosen / irreversible side-effects | Improved |
| add RAE to IMPALA | IMPALA · Sokoban 1k levels | levels solved | Improved |
| augment a random policy with reversibility-aware control (RAC) | random policy · Cartpole+ | score: 1152 -> 50k | Improved |
| add RAC action filtering with threshold 0.2 | PPO · Turf | irreversible side-effects during training | Improved |
| add RAC action filtering | PPO · Turf | learning speed | Hurt |
| vary RAC reversibility threshold: too low versus too high (ablation) | RAC · Cartpole+, Turf | safety vs task performance | Mixed |
Closest papers by meaning
- Robust and Scalable Autonomous Reinforcement Learning in Irreversible Environments (NeurIPS 2025 · similarity 0.88)
- Leave no Trace: Learning to Reset for Safe and Autonomous Reinforcement Learning (ICLR 2018 · similarity 0.87)
- Hybrid Inverse Reinforcement Learning (ICML 2024 · similarity 0.86)
- Provably Efficient Exploration in Inverse Constrained Reinforcement Learning (ICML 2025 · similarity 0.85)
- Is Inverse Reinforcement Learning Harder than Standard Reinforcement Learning? A Theoretical Perspective (ICML 2024 · similarity 0.85)
- Recent Advancements in Inverse Reinforcement Learning (AAAI 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
