Research map / 3D vision / 3D generation
EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents
Wenjia Wang, Liang Pan, Huaijin Pi, Yuke Lou, Xuqian Ren, Yifan Wu, Zhouyingcheng Liao, Lei Yang, Rishabh Dabral, Christian Theobalt, Taku Komura
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use dual-view optimization instead of monocular GVHMR (ablation) | EmbodMocap · Vicon studio comparison (5 sequences, 9420 frames) | W-MPJPE (mm), chunk=1000: 593.79 -> 169.11 | Improved |
| use dual-view instead of single-view optimization (ablation) | EmbodMocap · Vicon studio comparison (5 sequences, 9420 frames) | W-MPJPE (mm), chunk=100: 218.22 -> 72.86 | Improved |
| use dual-view instead of single-view for scene calibration (ablation) | EmbodMocap · scene alignment | calibration error: over 30cm -> about 5cm | Improved |
| finetune VIMO on EmbodMocap data (ablation) | VIMO · EMDB subset 2 | W-MPJPE (mm): 229.04 -> 222.93 | Improved |
| also finetune Pi3 on EmbodMocap data (ablation) | Pi3 + VIMO · EMDB subset 2 | W-MPJPE (mm): 222.93 -> 220.65 | Improved |
| train HOI skill on EmbodMocap motions instead of monocular GVHMR motions | physics character policy · Physics HOI skill: Support | success rate (%): 20.6 -> 66.0 | Improved |
| train on EmbodMocap motions instead of monocular motions | physics character policy · Physics HOI skill: Lie | success rate (%): 81.2 -> 89.4 | Improved |
| train on EmbodMocap motions instead of monocular on easy skills (Follow, Climb, Sit) | physics character policy · Physics HOI skill: Follow | success rate (%): 98.0 -> 99.8 | No clear effect |
| increase EmbodMocap clip amount from 1X to Full (ablation) | physics character policy · Physics HOI skill: Lie | success rate (%): 85.3 -> 89.4 | Improved |
| use EmbodMocap data instead of optical mocap | physics character policy · Physics HOI skill: Lie | success rate (%): 89.0 -> 89.4 | No clear effect |
Closest papers by meaning
- Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesis (ICCV 2023 · similarity 0.88)
- Real2Sim in HOI: Toward Physically Plausible HOI Reconstruction from Monocular Videos (NeurIPS 2026 · similarity 0.87)
- ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos (CVPR 2025 · similarity 0.87)
- MotionPRO: Exploring the Role of Pressure in Human MoCap and Beyond (CVPR 2025 · similarity 0.87)
- HumanVid: Demystifying Training Data for Camera-controllable Human Image Animation (NeurIPS 2024 · similarity 0.86)
- SurMo: Surface-based 4D Motion Modeling for Dynamic Human Rendering (CVPR 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
