AI Paper Atlas

Research map / Probabilistic and scientific modeling / Molecules and proteins

Monte Carlo Tree Search With Iteratively Refining State Abstractions

Samuel Sokota, Caleb Ho, Zaheen Farraz Ahmad, J Zico Kolter

NeurIPS 2021 · Probabilistic and scientific modeling › Molecules and proteins · approach: Machine learning for physical simulation · 3 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace progressive widening with abstraction refiningMCTS state selector · Toy Markov reward process with heterogeneous stochasticityvalue errorImproved
Set progressive widening alpha to a small value (ablation)Progressive widening · Toy MRPnumber of level-two childrenHurt
Set progressive widening alpha to a large value (ablation)Progressive widening · Toy MRPfocus on level-two childrenHurt
Use abstraction refining with a single hyperparameter setting instead of tuned progressive wideningPolicy evaluation · Continuous blackjackvalue error vs iterationsImproved
Use small alpha in progressive widening (ablation)Progressive widening · Continuous blackjackvalue error stabilityHurt
Use abstraction refining instead of progressive wideningMCTS control · Trap problemexpected returnImproved
Use a distance function that cannot distinguish falling into the trap (ablation)Abstraction refining · Trap problemexpected returnHurt
Use abstraction refining instead of progressive widening (k=1)AlphaZero latent-state search · Five by five Go opponent exploitationterritory marginMixed
Increase rollout budget and alpha (ablation)Progressive widening · Five by five Goexpected returnImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy