atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Large Batch Experience Replay

ICML 2022 · Reinforcement learning › Policy gradient and actor-critic · approach: Regularized scalable deep value learning · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use LaBER-mean with up-to-date priorities instead of uniform replayDQN on MinAtar · MinAtar gamesaverage episode rewardHelped
use LaBER instead of DQN with a larger uniform mini-batchDQN on MinAtar and Atari · MinAtar games and Atari gamesaverage rewardHelped
use LaBER with surrogate gradient norms instead of exact gradient norms (ablation)LaBER-mean · MinAtar gamesaverage episode rewardNo clear effect
increase the LaBER large-batch multiplier m (ablation)LaBER-mean with mini-batch size B=32 · MinAtar gamesaverage episode rewardHelped
use LaBER-lazy instead of LaBER-mean normalization (ablation)LaBER · MinAtar gamesaverage episode rewardMixed
use LaBER-max instead of LaBER-mean normalization (ablation)LaBER · MinAtar gamesaverage episode rewardHurt
add up-to-date LaBER resampling after PER priorities (ablation)PER · MinAtar gamesaverage episode rewardHelped
add up-to-date LaBER resampling after GER priorities (ablation)GER · MinAtar gamesaverage episode rewardHelped
add PER-LaBER or GER-LaBER priority sampling to vanilla LaBER (ablation)LaBER · MinAtar gamesaverage episode rewardNo clear effect
use LaBER rather than PER or GER prioritizationDQN, C51, SAC, and TD3 · 5 Atari games and 5 continuous-control tasksaverage returnHelped
tune PER or GER with alpha=0.6 and c=10^-10 rather than alpha=1 and c=0 (ablation)PER and GER · MinAtar gamesaverage episode rewardHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy