Research map / Vision-language and multimodal / Human and embodied modeling
Multimodal Context-Aware Human Motion Generation with Language, Vision, and Object
Junyu Shi, Yong Sun, Zhiyuan Zhang, Lijiang LIU, Yuxin He, Zhengjie Zhang, Qiang Nie
Read the paperCheck your idea against 137,217 papers
AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes multimodal context-aware human motion generation that conditions on language plus sparse visual observations (images revealing body states, object affordances, and interaction relations).
Problem
Text alone is ambiguous for specifying fine-grained spatial, temporal, and interaction details in human motion generation.
Approach
Uses sparse images as complementary context alongside language to specify intermediate body states, object affordances, and interaction relations for motion synthesis. Details beyond the abstract are unknown.
Closest papers by meaning
- MotionGPT3: Human Motion as a Second Modality (ICLR 2026 · similarity 0.92)
- VersatileMotion: A Unified Framework for Motion Synthesis and Comprehension (ECCV 2026 · similarity 0.92)
- The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motion (CVPR 2025 · similarity 0.91)
- Move as You Say Interact as You Can: Language-guided Human Motion Generation with Scene Affordance (CVPR 2024 · similarity 0.90)
- ReMoGPT: Part-Level Retrieval-Augmented Motion-Language Models (AAAI 2025 · similarity 0.90)
- HSI-GPT: A General-Purpose Large Scene-Motion-Language Model for Human Scene Interaction (CVPR 2025 · similarity 0.90)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
