Research map / 3D vision / Human pose estimation
Mining Multi-View Information: A Strong Self-Supervised Framework for Depth-Based 3D Hand Pose and Mesh Estimation
Pengfei Ren, Haifeng Sun, Jiachang Hao, Jingyu Wang, Qi Qi, Jianxin Liao
Check your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add UGCN-based cross-view fusion with joint coordinates instead of no fusion (ablation) | NYU multi-view hand-pose and mesh estimation · NYU multi-view fusion | mean joint error: 23.71 -> 13.05 (HME); 14.14 -> 11.16 (HPE) | Improved |
| Add visual features to UGCN node representations (ablation) | NYU multi-view hand-pose and mesh estimation · NYU multi-view fusion | mean joint error: 13.05 -> 12.62 (HME); 11.16 -> 10.46 (HPE) | Improved |
| Add node confidence to UGCN fusion (ablation) | NYU multi-view hand-pose and mesh estimation · NYU multi-view fusion | mean joint error: 12.62 -> 11.83 (HME); 10.46 -> 10.32 (HPE) | Improved |
| Use group-wise confidence encoding (ablation) | NYU multi-view hand-pose and mesh estimation · NYU multi-view fusion | mean joint error: 11.83 -> 11.64 (HME); 10.32 -> 10.29 (HPE) | Improved |
| Add cross-view model-fitting loss (ablation) | Self-supervised fine-tuning · NYU | mean joint error: 17.49 -> 13.49 (HME); 12.47 -> 12.32 (HPE) | Improved |
| Add multi-view self-distillation loss (ablation) | Self-supervised fine-tuning · NYU | mean joint error: 17.49 -> 12.52 (HME); 12.47 -> 10.71 (HPE) | Improved |
| Add prior loss (ablation) | Self-supervised fine-tuning · NYU | mean joint error: 12.39 -> 12.43 (HME); 10.66 -> 10.50 (HPE) | No clear effect |
| Use synthetic data translated with CycleGAN for pre-training (ablation) | Single-view estimation network · NYU | mean joint error: 24.32 -> 23.71 (HME); 16.21 -> 14.14 (HPE) | Improved |
| Fine-tune with both training and testing real samples rather than testing samples only (ablation) | Self-supervised method · NYU multi-view | mean joint error: 12.43 -> 10.49 (HME); 10.50 -> 10.23 (HPE) | Improved |
| Use pseudo multi-view training with augmented samples of one input | Self-supervised hand-pose estimation · NYU single-view | mean joint error: 16.96 -> 11.82 | Improved |
| Use cross-view fusion in the multi-view setting | Self-supervised hand-pose estimation · NYU multi-view | mean joint error: 12.26 -> 10.11 | Improved |
Closest papers by meaning
- HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning (ICCV 2023 · similarity 0.91)
- Self-Supervised 3D Hand Pose Estimation Through Training by Fitting (CVPR 2019 · similarity 0.89)
- Cross-Domain 3D Hand Pose Estimation With Dual Modalities (CVPR 2023 · similarity 0.88)
- Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs (CVPR 2016 · similarity 0.88)
- SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation With Semi-Supervised Learning (ICCV 2019 · similarity 0.88)
- Crossing Nets: Combining GANs and VAEs With a Shared Latent Space for Hand Pose Estimation (CVPR 2017 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
