Research map / Detection and segmentation / Open-set and few-shot detection
Hearing the Room Through the Shape of the Drum: Modal-Guided Sound Recovery from Multi-Point Surface Vibrations
Shai Bagon, Matan Kichler, Mark Sheinin
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| fuse multi-point vibrations with modal-guided inversion instead of single-point capture | speckle vibrometry sound recovery · drum and everyday objects, recovered audio | perceptual quality of recovered sound | Improved |
| use modal inversion instead of naive averaging of all points | multi-point fusion · drum recording | perceptual quality of recovered sound | Improved |
| use frequency-dependent modal alignment instead of single global delay-and-sum | multi-point fusion · drum recording | spectral content of recovered sound | Improved |
| extract modes from the original recording instead of a separate clap recording (ablation) | modal-guided recovery · drum recording | reconstruction quality | No clear effect |
| randomly omit 20% of recovered mode frequencies (ablation) | modal-guided recovery · drum recording | reconstruction sharpness and timbre | Hurt |
| add 20% spurious mode frequencies (ablation) | modal-guided recovery · drum recording | reconstruction artifacts | Hurt |
| use a wider laser grid span relative to the object surface | modal-guided recovery · object recordings | recovery quality vs averaging | Improved |
| small point baseline relative to mode wavelength (guitar) with modal method vs simple averaging | modal-guided recovery · guitar recording | recovery quality | No clear effect |
Closest papers by meaning
- Dual-Shutter Optical Vibration Sensing (CVPR 2022 · similarity 0.89)
- Analyzing Physical Impacts Using Transient Surface Wave Imaging (CVPR 2023 · similarity 0.85)
- Computational Speckle Pattern Interferometry (CVPR 2026 · similarity 0.85)
- Learning to See Inside Opaque Liquid Containers using Speckle Vibrometry (ICCV 2025 · similarity 0.84)
- Event-based Visual Vibrometry (ICCV 2025 · similarity 0.84)
- Hearing Hands: Generating Sounds from Physical Interactions in 3D Scenes (CVPR 2025 · similarity 0.81)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
