Research map / 3D vision / 3D generation
Egocentric World Model for Photorealistic Hand Object Interaction Synthesis
Dayou Li, Lulin Liu, Bangya Liu, Shijie Zhou, Jiu Feng, Ziqi Lu, Minghui Zheng, Chenyu You, Zhiwen Fan
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add hand kinematic embeddings (HKE) (ablation) | EgoHOI base · HOT3D | Missing Ratio: 28.77% -> 6.47% | Improved |
| add hand kinematic embeddings (HKE) (ablation) | EgoHOI base · HOT3D | MPJPE: 0.576 -> 0.015 | Improved |
| add OEE and EME to HKE (full model) (ablation) | EgoHOI · HOT3D | Missing Ratio: 6.47% -> 5.84% | Improved |
| add ego-motion embeddings (EME) (ablation) | EgoHOI base · HOT3D | ATE: 0.133 -> 0.096 | Improved |
| add ego-motion embeddings (EME) (ablation) | EgoHOI base · HOT3D | RRE: 15.249 -> 6.525 | Improved |
| add HKE and OEE to EME (full model) (ablation) | EgoHOI · HOT3D | ATE: 0.096 -> 0.084 | Improved |
| add object entity embeddings (OEE) (ablation) | EgoHOI base · HOT3D | Object-CLIP: 0.81 -> 0.83 | Improved |
| add object entity embeddings (OEE) (ablation) | EgoHOI base · HOT3D | Subject Consistency: 85.26% -> 87.90% | Improved |
| add object entity embeddings (OEE) (ablation) | EgoHOI base · HOT3D | OPE: 0.141 -> 0.131 | Improved |
| combine all three embeddings (full model) (ablation) | EgoHOI · HOT3D | OPE: 0.131 -> 0.015 | Improved |
| scale Cosmos from 2B to 14B (ablation) | Cosmos · HOT3D | ATE: 0.116 -> 0.112 | Improved |
| add Uni3C camera and motion control (ablation) | Wan-family baselines · HOT3D | ATE: 0.168 | Hurt |
Closest papers by meaning
- EgoSim: Egocentric World Simulator for Embodiment Interaction Generation (ECCV 2026 · similarity 0.92)
- EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision (ECCV 2026 · similarity 0.91)
- MEgoHand: Multimodal Egocentric Hand-Object Interaction Motion Generation (NeurIPS 2025 · similarity 0.91)
- EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views (NeurIPS 2024 · similarity 0.89)
- HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos (CVPR 2025 · similarity 0.88)
- Estimating Body and Hand Motion in an Ego-sensed World (CVPR 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
