atlas

Research map / 3D vision / Human pose estimation

Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors

CVPR 2024 · 3D vision › Human pose estimation · approach: Heatmap and coordinate pose encoding · 31 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes DynaIP, a two-stage part-based sparse-IMU human pose estimator that regresses pseudo-velocities and trains on unified real inertial mocap datasets across skeleton formats instead of synthetic AMASS data.

Problem

Full-body human pose estimation from six sparse IMUs suffers from motion ambiguity, underuse of acceleration, and poor generalization because training relies on synthetic virtual IMU data from AMASS with a gap to real measurements.

Approach

Maps real inertial mocap datasets with different skeleton formats (Xsens to SMPL) into one training set via one-to-one bone orientation mapping, learns pseudo-velocities of IMU joints in a first stage, and splits the body into three regions (upper limbs, torso, lower limbs) with a global feature extractor for coherence in a second pose-regression stage.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use DynaIP instead of PIPIMU-based pose estimation trained on real inertial mocap data · DIP-IMU, AnDy, UNIPD, CIP, Natural MotionSIP error (°): 17.62 -> 17.31; 9.49 -> 8.93; 8.90 -> 7.29; 12.68 -> 11.42; 19.62 -> 15.78Helped
Use DynaIP instead of PIPIMU-based pose estimation trained on real inertial mocap data · DIP-IMU, AnDy, UNIPD, CIP, Natural MotionAngular error (°): 8.33 -> 7.66; 4.09 -> 3.45; 3.59 -> 2.77; 5.52 -> 4.54; 7.49 -> 7.18Helped
Add part-based modeling (ablation)DynaIP* · DIP-IMU, CIP, Natural MotionSIP error (°): 14.97 -> 13.67; 13.00 -> 11.67; 31.62 -> 18.88Helped
Add part-based modeling (ablation)DynaIP* · DIP-IMU, CIP, Natural MotionAngular error (°): 6.02 -> 5.83; 4.86 -> 4.63; 9.60 -> 8.03Helped
Add pseudo-velocity learning (ablation)DynaIP* · DIP-IMU, CIP, Natural MotionSIP error (°): 14.87 -> 13.67; 12.54 -> 11.67; 29.15 -> 18.88Helped
Add pseudo-velocity learning (ablation)DynaIP* · DIP-IMU, CIP, Natural MotionAngular error (°): 6.11 -> 5.83; 4.89 -> 4.63; 10.49 -> 8.03Helped

Surprising findings

Limitations

Experimental setup

Datasets: DIP-IMU AnDy Emokine Virginia Natural Motion UNIPD CIP AMASS

Benchmarks: DIP-IMU AnDy UNIPD CIP Natural Motion

Metrics: SIP error global angular error position error mesh error

Baselines: DIP TransPose TIP PIP AMASS-trained model

Builds on: PIP TransPose DIP

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy