AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios

NeurIPS 2023 · Reinforcement learning › Visual and representation RL · approach: RL with tree search for discovery · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add self-supervised consistency loss (ablation)MuZero · Atari (six games)returnHelped
add self-supervised consistency loss (ablation)MuZero · MsPacmanreturnNo clear effect
predict value_prefix instead of reward (EfficientZero) (ablation)MuZero w/ SSL · AtarireturnMixed
predict value_prefix instead of reward (ablation)MuZero w/ SSL · MiniGrid KeyCorridorS3R3 sparse rewardreturnHurt
use AlphaZero with simulator instead of MuZeroMuZero · Connect4, Gomoku 6x6sample efficiencyHelped
larger action space dimension for Sampled EfficientZeroSampled EfficientZero · Breakout (4) vs MsPacman (9)returnHurt
Gaussian policy representation instead of factored discretizationSampled EfficientZero · continuous control and MuJoCoreturnHelped
Gumbel MuZero instead of MuZero at few simulationsMuZero · Gomoku, LunarLander, AtarireturnHelped
Gumbel MuZero instead of MuZero at high simulation countsMuZero · Gomoku, LunarLander, AtarireturnHurt
Stochastic MuZero instead of MuZeroMuZero · 2048 num_chances=2returnHelped
increase stochasticity num_chances 2 to 5Stochastic MuZero · 2048returnHurt
double simulation budget (NaiveDoubleSimulation) (ablation)MuZero · MiniGrid KeyCorridorS3R3 / FourRoomsreturnNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy