AI Paper Atlas

Research map / Multi-agent systems and games / Human-AI and goal-conditioned

PHYRE: A New Benchmark for Physical Reasoning

Anton Bakhtin, Laurens van der Maaten, Justin Johnson, Laura Gustafson, Ross Girshick

NeurIPS 2019 · Multi-agent systems and games › Human-AI and goal-conditioned · approach: Imitation and skill learning · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add online test-time updatesDQN · PHYRE-B cross-templateAUCCESS: 36.8 -> 56.2Improved
add online test-time updatesDQN · PHYRE-2B cross-templateAUCCESS: 23.2 -> 39.6Improved
add online test-time updatesMEM · PHYRE-B cross-templateAUCCESS: 18.5 -> 22.8Improved
add online test-time updatesMEM · PHYRE-2B cross-templateAUCCESS: 3.7 -> 4.9Improved
add online updates during testing (ablation)DQN · PHYRE within-templateAUCCESSHurt
remove class-balancing of positive and negative training examples (ablation)DQN · PHYRE, particularly PHYRE-2BAUCCESSHurt
fuse action features at the input to conv2 instead of conv5 (ablation)DQN · PHYREAUCCESSNo clear effect
fuse action features at every stage from conv2 to conv5 (ablation)DQN · PHYREAUCCESSNo clear effect
fuse action features with globally pooled conv5 features (ablation)DQN · PHYREAUCCESSHurt
increase the action encoder to one hidden layer of 1024 units (ablation)DQN · PHYREAUCCESSMixed
increase the action encoder to two hidden layers of 1024 units (ablation)DQN · PHYREAUCCESSMixed
rank more candidate actions (ablation)RAND, MEM, and DQN · PHYREAUCCESSMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy