AI Paper Atlas

Research map / Multi-agent systems and games / Human-AI and goal-conditioned

Transformer-based Working Memory for Multiagent Reinforcement Learning with Action Parsing

Yaodong Yang, Guangyong Chen, Weixun Wang, Xiaotian Hao, Jianye HAO, Pheng-Ann Heng

NeurIPS 2022 · Multi-agent systems and games › Human-AI and goal-conditioned · approach: Language-grounded reinforcement agents · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add Agent Transformer Memory (ATM) in place of GRU agent networkQMIX and QPLEX · SMAC 4m_vs_5m, 5m_vs_6m, 6h_vs_8z, corridortest win rateImproved
use ATM instead of GRU agent networkQMIX and QPLEX · SMAC 6h_vs_8z and corridortest win rateImproved
add memory slots to ATM (vs w/o mem) (ablation)ATM on QMIX · SMAC 4m_vs_5m, 5m_vs_6mtest win rateImproved
add Entity-Bound Action Layer to ATM (vs w/o EBA) (ablation)ATM on QMIX · SMAC 4m_vs_5m, 5m_vs_6mtest win rateImproved
add both memory and Entity-Bound Action Layer to basic transformer (trm) (ablation)ATM on QMIX · SMAC 4m_vs_5m, 5m_vs_6mtest win rateImproved
use working memory updating instead of relational memory or AMRL (ablation)ATM · SMAC 4m_vs_5m, 5m_vs_6mtest win rateImproved
add any memory updating scheme (working, relational, AMRL, GRU) vs no memory (ablation)ATM · SMAC 4m_vs_5m, 5m_vs_6mtest win rateImproved
vary memory slot number from 0 to 5 (ablation)ATM · SMAC 4m_vs_5m, 5m_vs_6mepisodic returnMixed
use ATM instead of GRU or MLP agent networkMAPPO and MAA2C · LBF 15x15_3p_5f, 15x15_4p_5f, 15x15_4p_6fepisodic returnImproved
use ATM instead of GRU or MLP agent networkMAPPO · LBF 15x15_4p_6fepisodic returnImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy