AI Paper Atlas

Research map / Detection and segmentation / Open-set and few-shot detection

Generative Modeling of Audible Shapes for Object Perception

Zhoutong Zhang, Jiajun Wu, Qiujia Li, Zhengjia Huang, James Traer, Josh H. McDermott, Joshua B. Tenenbaum, William T. Freeman

ICCV 2017 · Detection and segmentation › Open-set and few-shot detection · approach: Hand-object and articulated interaction · 31 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the audio stream to a visual-only network for material recognition (ablation)ResNet-18 visual stream · Material classification (Sound-20K, texture-less)accuracy (%): 46.2 -> 68.5Improved
add the visual stream to an audio-only network for material recognition (ablation)SoundNet-8 audio stream · Material classification (Sound-20K, texture-less)accuracy (%): 65.6 -> 68.5Improved
add the audio stream to a visual-only network for material recognition (ablation)ResNet-18 visual stream · Material classification (Physics 101)accuracy (%): 94.5 -> 99.4Improved
add the visual stream to an audio-only network for material recognition (ablation)SoundNet-8 audio stream · Material classification (Physics 101)accuracy (%): 78.1 -> 99.4Improved
add audio to visual input for shape attribute recognition (ablation)ResNet-18 visual stream · Shape attribute recognition (Sound-20K)average accuracy (%): 79.4 -> 83.9Improved
add visual to audio input for shape attribute recognition (ablation)SoundNet-8 audio stream · Shape attribute recognition (Sound-20K)average accuracy (%): 76.1 -> 83.9Improved
add audio to visual input for shape attribute recognition (ablation)ResNet-18 visual stream · Shape attribute recognition (Physics 101)average accuracy (%): 96.6 -> 97.0Improved
add visual to audio input for shape attribute recognition (ablation)SoundNet-8 audio stream · Shape attribute recognition (Physics 101)average accuracy (%): 86.5 -> 97.0Improved
use deeper conv7 features instead of pool5 for transfer of synthetic-trained audio features (ablation)SoundNet-8 trained on Sound-20K · Material classification transfer (Physics 101, linear SVM)accuracy (%): 29.6 -> 41.5Improved
use deeper conv7 features instead of pool5 for transfer of synthetic-trained audio features (ablation)SoundNet-8 trained on Sound-20K · Material classification transfer (Greatest Hits, linear SVM)accuracy (%): 33.7 -> 39.2Improved
use synthetic-trained conv7 features instead of MFCClinear SVM material classifier · Material classification transfer (Physics 101, linear SVM)accuracy (%): 40.7 -> 41.5No clear effect
use synthetic-trained conv7 features instead of MFCClinear SVM material classifier · Material classification transfer (Greatest Hits, linear SVM)accuracy (%): 38.1 -> 39.2No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy