AI Paper Atlas

Research map / Multi-agent systems and games / Human-AI and goal-conditioned

Forethought and Hindsight in Credit Assignment

Veronica Chelu, Doina Precup, Hado P van Hasselt

NeurIPS 2020 · Multi-agent systems and games › Human-AI and goal-conditioned · approach: Language-grounded reinforcement agents

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
channelling structure (large fan-in, small fan-out) favors backward planning over forward planning (ablation)backward planning · Random chain MRP, 3-level bipartite graph (n_x=500, n_y=5)value prediction errorImproved
broadcasting structure (small fan-in, large fan-out, n_x=5, n_y=500) with backward instead of forward planning (ablation)backward planning · Random chain MRP, 3-level bipartite graphvalue prediction errorHurt
plan backward from s instead of s' in full learning setting (ablation)Online Backward-Dyna · discrete navigation task, full learninglearning efficiencyImproved
plan backward from s' instead of s in pure planning setting (ablation)Online Backward-Dyna · discrete navigation task, pure planninglearning efficiencyImproved
use backward model instead of forward model under stochastic transitions (ablation)Online Backward-Dyna · discrete navigation task, stochastic dynamicscredit assignment damage from model errorImproved
use backward planning with stochastic rewards (ablation)Online Backward-Dyna · discrete navigation task, stochastic rewardsspeed of finding optimal policyImproved
extremely stochastic rewards with backward models (ablation)Online Backward-Dyna · discrete navigation task, extreme reward stochasticitymodel accuracyHurt
model misspecification applied to forward vs backward planning (ablation)forward planning · discrete navigation taskperformanceHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy