Research map / Multi-agent systems and games / Human-AI and goal-conditioned
Steering Visuomotor Policy in Open Worlds via Cross-View Goal Alignment
Shaofei Cai, Zhancun Mu, Anji Liu, Yitao Liang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add target visibility loss to behavior cloning (ablation) | ROCKET-2 · Minecraft (3 tasks avg) | success rate: 0.65 -> 0.71 | Improved |
| add cross-view consistency loss on top of visibility loss (ablation) | ROCKET-2 · Minecraft (3 tasks avg) | success rate: 0.71 -> 0.94 | Improved |
| rely on behavior cloning loss only (ablation) | ROCKET-2 · Minecraft (3 tasks avg) | success rate: 0.94 -> 0.65 | Hurt |
| zero-shot transfer to Unreal with action mapping vs YOLO-Gemma 3 | ROCKET-2 · ATEC 2025 challenge | success rate: 26% -> 38% | Improved |
| decouple goal view from agent view (cross-view goals) | ROCKET-2 vs ROCKET-1 · Minecraft Interaction Benchmark | inference speed: 3x to 6x speedup | Improved |
Closest papers by meaning
- Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction (CVPR 2023 · similarity 0.89)
- ROCKET-1: Mastering Open-World Interaction with Visual-Temporal Context Prompting (CVPR 2025 · similarity 0.88)
- OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents (NeurIPS 2024 · similarity 0.87)
- ADAM: An Embodied Causal Agent in Open-World Environments (ICLR 2025 · similarity 0.86)
- GROOT: Learning to Follow Instructions by Watching Gameplay Videos (ICLR 2024 · similarity 0.86)
- Steve-Eye: Equipping LLM-based Embodied Agents with Visual Perception in Open Worlds (ICLR 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
