AI Paper Atlas

Research map / 3D vision / Human pose estimation

Sounding Bodies: Modeling 3D Spatial Sound of Humans Using Body Pose and Audio

Xudong XU, Dejan Markovic, Jacob Sandakly, Todd Keebler, Steven Krenn, Alexander Richard

NeurIPS 2023 · 3D vision › Human pose estimation · approach: Physics and sensor-based motion capture · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add full body pose instead of no pose (ablation)Ours · speechSDR: 6.682 -> 9.580Improved
add full body pose instead of no pose (ablation)Ours · non-speechSDR: 2.518 -> 3.004Improved
use full body pose instead of head pose only (ablation)Ours · speechSDR: 9.264 -> 9.580Improved
use full body pose instead of head pose only (ablation)Ours · non-speechSDR: 2.848 -> 3.004Improved
add head pose to no-pose model (ablation)Ours · speechSDR: 6.682 -> 9.264Improved
increase head-mounted input mics from 1 to 7 (ablation)Ours · non-speechSDR: 0.848 -> 3.004Improved
increase head-mounted input mics from 1 to 7 (ablation)Ours · speechSDR: 8.259 -> 9.580Improved
increase input mics from 3 to 7 (ablation)Ours · non-speechSDR: 2.338 -> 3.004Improved
increase input mics from 3 to 7 (ablation)Ours · speechSDR: 9.526 -> 9.580Improved
replace l2 loss with shift-l2 loss (ablation)Ours · non-speechSDR: 2.557 -> 2.956Improved
replace multiscale STFT loss with shift-l2 + multiscale STFT (ablation)Ours · speechSDR: -5.077 -> 9.580Improved
add multiscale STFT to shift-l2 loss (ablation)Ours · speechamplitude error: 9.716 -> 7.059Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy