Research map / 3D vision / 3D generation
SoundCam: A Dataset for Finding Humans Using Room Acoustics
Mason Long Wang, Samuel Clarke, Jui-Hsien Wang, Ruohan Gao, Jiajun Wu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use multichannel VGGish trained from scratch instead of pretrained VGGish | VGGish · Treated Room sine RIR, 10 mics | localization error (cm): 93.6 (53.1) -> 18.1 (13.1) | Improved |
| Reduce microphones from 10 to 1 (ablation) | VGGish (multichannel) · Treated Room sine RIR | localization error (cm): 18.1 -> 71.6 (50.4) | Hurt |
| Reduce microphones from 10 to 4 (ablation) | VGGish (multichannel) · Treated Room sine RIR | localization error (cm): 18.1 -> 17.2 (16.2) | No clear effect |
| Use music-derived RIR instead of sine-sweep RIR | VGGish (multichannel) · Treated Room | localization error (cm): 18.1 -> 31.4 (23.9) | Hurt |
| Test on a different human than trained on | VGGish (multichannel) · Living Room music RIR | localization error (cm): 25.6 (18.4) -> 50.7 (39.7) | Hurt |
| Train on base layout, test with fabric panels | VGGish (multichannel) · Treated Room | localization error (cm): 18.1 -> 132.6 (107.8) | Hurt |
| Increase training data from 25 to 800 points (ablation) | VGGish (multichannel) · Living Room | localization error (cm): 166.5 (61.2) -> 27.9 (22.0) | Improved |
| Downsample audio from 48 kHz to 16 kHz (ablation) | VGGish (multichannel) · Treated Room localization, 4 mics | localization error (cm): 17.2 (16.2) -> 21.8 (16.1) | Hurt |
| Downsample audio from 48 kHz to 16 kHz (ablation) | VGGish (multichannel) · Treated Room localization, 1 mic | localization error (cm): 71.6 (50.4) -> 49.4 (54.3) | Improved |
| Downsample audio from 48 kHz to 16 kHz (ablation) | VGGish (multichannel) · Treated Room human identification, 10 mics | classification accuracy (%): 82 -> 63 | Hurt |
| Use silence instead of RIR for identification | VGGish (multichannel) · Treated Room identification, 10 mics | classification accuracy (%): 82 -> 20 | Hurt |
| Use raw music instead of music-derived RIR for detection | VGGish (multichannel) · Treated Room detection, 10 mics | classification accuracy (%): 99 -> 75 | Hurt |
Closest papers by meaning
- Hearing Anywhere in Any Environment (CVPR 2025 · similarity 0.89)
- Deep Neural Room Acoustics Primitive (ICML 2024 · similarity 0.87)
- Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark (CVPR 2024 · similarity 0.87)
- Hearing Anything Anywhere (CVPR 2024 · similarity 0.87)
- AV-RIR: Audio-Visual Room Impulse Response Estimation (CVPR 2024 · similarity 0.86)
- SoundVista: Novel-View Ambient Sound Synthesis via Visual-Acoustic Binding (CVPR 2025 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
