AI Paper Atlas

Research map / 3D vision / Depth and stereo

Camera Pose Estimation and Localization with Active Audio Sensing

Karren Yang, Michael Firman, Eric Brachmann, Clément Godard

ECCV 2022 · 3D vision › Depth and stereo · approach: Scene coordinate regression for localization · 7 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add depth-cubemap distillation pretraining to the audio encoder (ablation)audio-only relative pose · Replica relative pose (standard baseline, <90 deg)Acc@20deg (%): 21.9 -> 38.1Improved
add depth-cubemap distillation pretraining to the audio encoder (ablation)audio-only relative pose · Matterport3D relative pose (standard baseline, <90 deg)Acc@20deg (%): 13.8 -> 17.7Improved
add depth-cubemap distillation pretraining to the audio encoder (ablation)audio descriptor · Replica place recognition (all queries)Recall@1: 0.59 -> 0.65Improved
add depth-cubemap distillation pretraining to the audio encoder (ablation)audio descriptor · Matterport3D place recognition (all queries)Recall@1: 0.41 -> 0.49Improved
add depth-cubemap distillation pretraining to the audio encoder (ablation)audio-visual PoseNet · Matterport3D absolute pose regression (all queries)position error: 3.34 -> 1.86Improved
add audio expert to SuperGlue visual matchingvisual matching · Replica relative pose (wide baseline, >90 deg)Acc@20deg (%): 2.0 -> 31.5Improved
add audio expert to SuperGlue visual matchingvisual matching · Replica relative pose (standard baseline, <90 deg)Acc@20deg (%): 39.9 -> 47.7Improved
add learned gating instead of fixed gating on visual matching (ablation)visual matching + audio · Replica relative pose (standard baseline, <90 deg)Acc@20deg (%): 47.7 -> 55.4Improved
add learned gating instead of fixed gating on visual matching (ablation)visual matching + audio · Replica relative pose (wide baseline, >90 deg)Acc@20deg (%): 31.5 -> 37.6Improved
add audio features to Siamese visual regressionvisual regression · Replica relative pose (standard baseline, <90 deg)Acc@20deg (%): 21.0 -> 24.1Mixed
add audio expert and learned gating to NetVLAD descriptorsNetVLAD · Replica place recognition (all queries)Recall@1: 0.59 -> 0.71Improved
add audio features to PoseNetPoseNet · Matterport3D absolute pose regression (all queries)position error: 2.17 -> 1.86Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy