AI Paper Atlas

Research map / Video / Video-language understanding

Generation-for-Understanding with Structured Action Scripts for Embodied Multimodal Learning

Hange Zhou, Mingzhe Zhang, Hongyu Ge, Xiaotang Wang, Enjun Du, Runqing Xu, Yongqi Zhang

NeurIPS 2026 · Video › Video-language understanding · approach: Long video understanding

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes generation-for-understanding with structured action scripts to help VLMs recover fine-grained intermediate actions and result states in embodied videos.

Problem

VLMs used as perception and reasoning modules for embodied intelligence are brittle at understanding fine-grained physical processes in videos, often recognizing the overall task while missing intermediate actions and result states.

Approach

Uses generation of structured action scripts as an auxiliary objective so that the model learns to produce the intermediate actions and result states that govern how an embodied interaction unfolds, improving understanding.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy