Research map / Vision-language and multimodal / Robot action and navigation
Learning to Set Waypoints for Audio-Visual Navigation
Changan Chen, Sagnik Majumder, Ziad Al-Halah, Ruohan Gao, Santhosh Kumar Ramakrishnan, Kristen Grauman
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| learn audio-visual waypoints with end-to-end reinforcement learning and structured acoustic memory | AudioGoal navigation · Replica heard | SPL: 78.2 -> 86.6 | Improved |
| learn audio-visual waypoints with end-to-end reinforcement learning and structured acoustic memory | AudioGoal navigation · Matterport3D heard | SPL: 55.1 -> 72.3 | Improved |
| learn audio-visual waypoints with end-to-end reinforcement learning and structured acoustic memory | AudioGoal navigation · Replica unheard | SNA: 16.7 -> 27.1 | Improved |
| learn audio-visual waypoints with end-to-end reinforcement learning and structured acoustic memory | AudioGoal navigation · Matterport3D unheard | SPL: 25.9 -> 40.9 | Improved |
| add acoustic memory (ablation) | AV-WaN · Matterport3D unheard | SPL: 36.7 -> 40.9 | Improved |
| add acoustic memory (ablation) | AV-WaN · Replica unheard | SR: 63.3 -> 52.8 | Hurt |
| add geometric map (ablation) | AV-WaN · Replica unheard | SPL: 27.0 -> 34.7 | Improved |
| add geometric map (ablation) | AV-WaN · Matterport3D unheard | SPL: 25.4 -> 40.9 | Improved |
| add acoustic and geometric maps (ablation) | AV-WaN · Matterport3D unheard | SPL: 20.5 -> 40.9 | Improved |
| use learned waypoints instead of primitive actions (ablation) | AV-WaN · Matterport3D heard | SPL: 44.3 -> 72.3 | Improved |
| use learned waypoints instead of primitive actions (ablation) | AV-WaN · Replica heard | SPL: 79.8 -> 86.6 | Improved |
| add acoustic memory (ablation) | AV-WaN · Replica heard | SPL: 85.7 -> 86.6 | Improved |
Closest papers by meaning
- CAVEN: An Embodied Conversational Agent for Efficient Audio-Visual Navigation in Noisy Environments (AAAI 2024 · similarity 0.91)
- Towards Audio-Visual Navigation in Noisy Environments: A Large-Scale Benchmark Dataset and an Architecture Considering Multiple Sound-Sources (AAAI 2025 · similarity 0.90)
- RILA: Reflective and Imaginative Language Agent for Zero-Shot Semantic Audio-Visual Navigation (CVPR 2024 · similarity 0.89)
- SAVVY: Spatial Awareness via Audio-Visual LLMs through Seeing and Hearing (NeurIPS 2025 · similarity 0.89)
- RAO-Nav: Probing Omni-Language Models for Zero-shot Semantic Audio-Visual Navigation (NeurIPS 2026 · similarity 0.89)
- Audible World Models: Spatially Aware Sound Generation for 3D Worlds (NeurIPS 2026 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
