AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

Scaling All-Goals Updates in Reinforcement Learning Using Convolutional Neural Networks

Fabio Pardo, Vitaly Levdik, Petar Kormushev

AAAI 2020 · Reinforcement learning › Visual and representation RL · approach: Goal-conditioned policy learning · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use a convolutional Q-map without compression instead of a goal-in-input networkGoal-conditioned pathfinding in random mazes · Random mazes, unseen test mazessuccess rate: 99%Improved
Use a Q-map without compression instead of a compressed Q-map (ablation)Q-map maze pathfinding · Random mazes, unseen test mazessuccess rateImproved
Use Q-map all-goals outputs instead of goal-in-input outputsGoal-conditioned pathfinding · Random mazessuccess rateImproved
Use Q-map all-goals outputs instead of goal-in-input outputsGoal-conditioned box pushing · Sokoban, unseen 10×10 puzzlessuccess rateImproved
Train the goal-in-input baseline with random goals rather than all goals (ablation)Goal-in-input Sokoban baseline · Sokoban, unseen 10×10 puzzlessuccess rateMixed
Replace random actions with random goal-directed trajectoriesMontezuma's Revenge exploration policy · Montezuma's Revengekeys picked up: once; 398 timesImproved
Replace ε-greedy exploration actions with Q-map goal-directed trajectoriesDQN task learner · Super Mario All-Starsflags reached: 9 times; 33 timesImproved
Replace ε-greedy exploration actions with Q-map goal-directed trajectoriesDQN task learner · Super Mario All-Starsfinal performance: 30% higherImproved
Transfer a pre-trained Q-map from another level instead of training from scratch (ablation)Q-map goal-reaching model · Super Mario All-Stars, different levellearning speedImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy