AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

A Simple Decentralized Cross-Entropy Method

Zichen Zhang, Jun Jin, Martin Jagersand, Jun Luo, Dale Schuurmans

NeurIPS 2022 · Reinforcement learning › Policy gradient and actor-critic · approach: Model-based RL with guarantees · 4 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace centralized CEM with multiple independent CEM instances and select the best instanceCEM planning · Continuous-control environmentsevaluation returnImproved
Replace PETS's centralized CEM with independent CEM instancesPETS · Continuous-control environmentsevaluation returnImproved
Use decentralized instances for action-space planningPETS and DecentPETS · Hopperevaluation returnNo clear effect
Use a larger ensemble of policy networks in parameter-space planningDecentCEM-P · Antevaluation returnHurt
Increase ensemble size beyond the best trade-off point (ablation)DecentCEM-A/P and DecentPETS · Reacher environmentsevaluation returnMixed
Increase the POPLIN policy network size to match the ensemble's total weights (ablation)POPLIN-A/P · Reacher and PETS-Pusherevaluation returnMixed
Remove the CEM policy-improvement step (ablation)POPLIN-A/P and DecentCEM-A/P · Continuous-control environmentsevaluation returnHurt
Use DecentCEM-A policy networks directly for control without CEM (ablation)DecentCEM-A · Continuous-control environmentsevaluation returnMixed
Use DecentCEM-P policy networks directly for control without CEM (ablation)DecentCEM-P · Continuous-control environmentsevaluation returnHurt
Increase the number of independent CEM instances at a fixed total sample budget (ablation)DecentCEM · 1D multimodal optimizationtime to run 10 trialsHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy