AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

High Entropy Regularization Leads to Symmetry Equivariant Policies in Dec-POMDPs

Johannes Forkel, Constantin Ruhdorfer, Michael Beukman, Andreas Bulling, Jakob Foerster

NeurIPS 2026 · Reinforcement learning › Policy gradient and actor-critic · approach: Variance-reduced policy gradients

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proves that in any Dec-POMDP, sufficiently high entropy regularization makes tabular softmax policy gradient flow converge to a unique joint policy that is equivariant to all Dec-POMDP symmetries, so independently trained policies are cross-play compatible.

Problem

Independently trained policies in decentralized cooperative settings (Dec-POMDPs) often fail to be compatible in cross-play because learning converges to arbitrary, symmetry-breaking conventions.

Approach

Shows that sufficiently high entropy regularization makes policy gradient flow with tabular softmax parametrization converge from any initialization to the same symmetry-equivariant joint policy, yielding cross-play compatibility as a theoretical guarantee.

Key results

Limitations

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy