Research map / 3D vision / Human pose estimation
Efficient 6-DoF Tracking of Handheld Objects from an Egocentric Viewpoint
Rohit Pandey, Pavel Pidlypenskyi, Shuoran Yang, Christine Kaeser-Chen
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add tz depth target to predicted fields (ablation) | SSD-AF-2D · HMD Controller test set | uv position MAE (pixels): 12.41 -> 10.23 | Improved |
| use stacked stereo image pair as input and predict keypoint in both images (ablation) | SSD-AF-3D · HMD Controller test set | uv position MAE (pixels): 10.23 -> 8.45 | Improved |
| use stacked stereo input with both-image predictions (ablation) | SSD-AF-3D · HMD Controller test set | xyz position MAE (m): 0.0493 -> 0.0335 | Improved |
| use stacked stereo input with both-image predictions (ablation) | SSD-AF-3D · HMD Controller test set | detection mAP @0.5 IOU: 0.5131 -> 0.7767 | Improved |
| add tz depth target to predicted fields (ablation) | SSD-AF-2D · HMD Controller test set | detection mAP @0.5 IOU: 0.5180 -> 0.5131 | No clear effect |
| use stereo pair instead of single image (ablation) | SSD-AF-3D · HMD Controller test set | mobile CPU latency (ms): 30.649 -> 31.768 | No clear effect |
| replace regression with discrete 27-bin orientation classification (ablation) | orientation prediction · HMD Controller test set | orientation bin mAP: 0.3627 -> 0.6538 | Improved |
| use 512 bins instead of 27 bins (ablation) | SSD-AF-Binned · HMD Controller test set | bin classification mAP: 0.6538 -> 0.3627 | Hurt |
| use quaternion instead of Euler orientation encoding (ablation) | SSD-AF-Stereo6D · HMD Controller test set | pitch MAE (radians): 1.5840 -> 1.4790 | Improved |
| use quaternion instead of Euler orientation encoding (ablation) | SSD-AF-Stereo6D · HMD Controller test set | xyz position MAE (m): 0.0448 -> 0.0521 | Hurt |
| bin orientation per axis instead of regressing quaternion (ablation) | SSD-AF-Stereo6D-Quat · HMD Controller test set | pitch MAE (radians): 1.4790 -> 0.8594 | Improved |
| predict 4 keypoints instead of quaternion regression (ablation) | SSD-AF-Stereo6D-Quat · HMD Controller test set | pitch and roll MAE (radians): 1.4790 -> 1.108; 0.6653 -> 1.203 | Mixed |
Closest papers by meaning
- Instance Tracking in 3D Scenes from Egocentric Videos (CVPR 2024 · similarity 0.84)
- FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Video (CVPR 2025 · similarity 0.84)
- HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos (CVPR 2025 · similarity 0.83)
- EMHI: A Multimodal Egocentric Human Motion Dataset with HMD and Body-Worn IMUs (AAAI 2025 · similarity 0.82)
- Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input (CVPR 2025 · similarity 0.82)
- HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observations (CVPR 2024 · similarity 0.82)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
