atlas

Research map / Reinforcement learning / Visual and representation RL

Value Iteration Networks

NeurIPS 2016 · Reinforcement learning › Visual and representation RL · approach: RL for combinatorial routing

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add value iteration planning module (VIN) vs reactive CNN policygrid-world policy · Grid-world 28x28success rate: 97% vs 74.2%Helped
add value iteration planning module (VIN) vs reactive CNN policygrid-world policy · Grid-world 16x16success rate: 99.3% vs 87.6%Helped
untie weights of the K recurrent VI layers (ablation)VIN · Grid-world 16x16 (weight sharing)success rate: 95.6% vs 99.3%Hurt
add VIN planning module with TRPO and curriculum traininggrid-world RL policy · Grid-world RL 16x16success rate: 82.5% vs 33.1%Helped
add VIN planning module with TRPO and curriculum traininggrid-world RL policy · Grid-world RL 8x8success rate: 90.9% vs 86.9%Helped
add VI planning on a coarse category subgraph to reactive WebNav policyWebNav reactive baseline · WebNav random startsuccessful runs out of 4000: 346 vs 304Helped
add VI planning on a coarse category subgraph to reactive WebNav policyWebNav reactive baseline · WebNav root startsuccessful runs out of 2000: 1030 vs 1025No clear effect
add VI planning on Wikipedia for Schools graph to reactive WebNav policyfull Wikipedia WebNav · full Wikipedia top-1 / top-4top-1 and top-4 test error: top-1 error 50.562% vs 52.019%; top-4 error 26.055% vs 24.424%Mixed
learn VI from raw terrain image instead of obstacle labelsMars rover VIN · Mars navigationsuccess rate: 84.8% vs 90.3% best achievable with labeled obstaclesNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy