AI Paper Atlas

Research map / 3D vision / Human pose estimation

COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation

Jiefeng Li, Ye Yuan, Davis Rempe, Haotian Zhang, Pavlo Molchanov, Cewu Lu, Jan Kautz, Umar Iqbal

ECCV 2024 · 3D vision › Human pose estimation · approach: Physics and sensor-based motion capture · 11 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the controlled denoiser (controlled sampling) to COIN-SDS (ablation)COIN · RICHW-MPJPE (mm): 825.0 -> 254.5Improved
add soft inpainting (ablation)COIN · RICHPA-MPJPE (mm): 47.6 -> 42.9Improved
add soft inpainting (ablation)COIN · RICHW-MPJPE (mm): 325.8 -> 254.5Improved
use dynamic control (previous optimized motion as control signal) (ablation)COIN · RICHW-MPJPE (mm): 293.8 -> 254.5Improved
add human-scene relation loss (ablation)COIN · RICHW-MPJPE (mm): 273.0 -> 254.5Improved
add human-scene relation loss (ablation)COIN · HCM camera motionATE-S (mm): 402.1 -> 385.9Improved
use COIN-SDS instead of vanilla SDS (ablation)COIN · RICHW-MPJPE (mm): 1453.5 -> 254.5Improved
use COIN-SDS instead of noise optimization of the diffusion latent (ablation)COIN · RICHW-MPJPE (mm): 414.8 -> 254.5Improved
add SDS loss term to the objective (ablation)COIN · RICHW-MPJPE (mm): 480.6 -> 254.5Improved
add smoothness loss (ablation)COIN · RICHW-MPJPE (mm): 256.1 -> 254.5No clear effect
use guided sampling for the diffusion prior (ablation)COIN · RICHW-MPJPE (mm): 254.5 -> 1384.6Hurt
replace DROID-SLAM with ParticleSfM for camera init (ablation)COIN · EMDB (converged subset)W-MPJPE (mm): 350.1 -> 330.9Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy