AI Paper Atlas

Research map / Video / Video segmentation and tracking

Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video

Ikechukwu D Adebi, Sagnik Majumder, Kristen Grauman

ECCV 2026 · Video › Video segmentation and tracking · approach: Layered video decomposition and dynamics · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add spatial audio (DOA + binaural) to vision-only Reloc3rReloc3r · Ego-Exo4D valTotal AUC@5: 0.57 -> 0.81Improved
add spatial audio (DOA + binaural) to vision-only Reloc3rReloc3r · Ego-Exo4D valTotal AUC@20: 7.33 -> 8.82Improved
add DOA spectrum alongside binaural embedding (ablation)Ours · Ego-Exo4D valTotal AUC@20: 8.41 -> 8.82Improved
add binaural embedding alongside DOA spectrum (ablation)Ours · Ego-Exo4D valTotal AUC@20: 8.34 -> 8.82Improved
use learned binauralized embedding instead of monaural embedding (ablation)Ours · Ego-Exo4D valTotal AUC@5: 0.74 -> 0.81Improved
use the proposed fusion instead of audio-visual cross-attentionReloc3r-AV Cross-Att · Ego-Exo4D valTotal AUC@20: 8.34 -> 8.82Improved
add spatial audio under corrupted visionReloc3r · Ego-Exo4D val (corrupted vision)Total AUC@5: 0.21 -> 0.35Improved
add spatial audio under corrupted visionReloc3r · HM3D-SS test (corrupted vision)rotation MAE (deg): 3.83 -> 2.46Improved
add spatial audio on clean simulated videoReloc3r · HM3D-SS testrotation MAE (deg): 0.09 -> 0.06Improved
add IMU input to the audio-visual model (ablation)Ours · Ego-Exo4D valTotal AUC@5: 0.81 -> 0.85Improved
replace synchronized audio with cross-scene audio (ablation)Ours · Ego-Exo4D valTotal AUC@5: 0.81 -> 0.50Hurt
replace synchronized audio with same-scene shuffled audio (ablation)Ours · Ego-Exo4D valTotal AUC@5: 0.81 -> 0.66Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy