AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

Thinking Fast and Slow with Deep Learning and Tree Search

Thomas Anthony, Zheng Tian, David Barber

NeurIPS 2017 · Reinforcement learning › Visual and representation RL · approach: RL for combinatorial routing · 190 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use tree-policy targets instead of chosen-action targets (ablation)Hex imitation learning from MCTS · Hex 9×9Elo strength: 50±13 Elo strongerImproved
Use tree-policy targets instead of chosen-action targets (ablation)Hex imitation learning from MCTS · Hex 9×9top-1 prediction error: 47.0% -> 47.7%No clear effect
Add 3 batches of 100,000 DAgger moves (ablation)TPT network · Hex 9×9Elo strength: +120 EloImproved
Add policy-network guidance to MCTS (ablation)MCTS on Hex · Hex 9×9, versus baseline MCTSgames won: 97%Improved
Double vanilla MCTS iterations instead of using neural policy guidance (ablation)Vanilla MCTS · Hex 9×9, versus vanilla MCTSwin rate: 56%Improved
Use online dataset aggregation rather than batch ExIt (ablation)ExIt initialized from the best imitation network · Hex 9×9policy strengthImproved
Retain the full growing dataset rather than a fixed-size recent-move buffer (ablation)Online ExIt · Hex 9×9policy strengthImproved
Add value estimation to the policy network (ablation)Distributed online ExIt · Hex 9×9expert play qualityImproved
Use iterative tree-search expert improvement and imitation rather than REINFORCE updatesHex policy learning · Hex 9×9policy strengthImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy