AI Paper Atlas

Research map / Video / Video segmentation and tracking

Localizing Visual Sounds the Hard Way

Honglie Chen, Weidi Xie, Triantafyllos Afouras, Arsha Nagrani, Andrea Vedaldi, Andrew Zisserman

CVPR 2021 · Video › Video segmentation and tracking · approach: Self-supervised video representation learning · 172 citations (OpenAlex)

Check your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use hard-negative mining and Tri-map trainingOurs · Flickr SoundNet test set, Flickr10k trainingcIoU: 0.546 -> 0.582Improved
Use hard-negative mining and Tri-map trainingOurs · VGG-SS test set, VGG-Sound144k trainingcIoU: 0.297 -> 0.344Improved
Add complementary-region negatives without excluding uncertain pixels (ablation)Ours · Flickr SoundNet test set, VGG-Sound144k trainingcIoU: 0.675 -> 0.667Hurt
Add a Tri-map that ignores uncertain regions during training (ablation)Ours · Flickr SoundNet test set, VGG-Sound144k trainingcIoU: 0.667 -> 0.700Improved
Set positive threshold to 0.65 and negative threshold to 0.4 (ablation)Ours with Tri-map · Flickr SoundNet test set, VGG-Sound144k trainingcIoU: 0.703 -> 0.719Improved
Use positive threshold 0.7 and negative threshold 0.3 (ablation)Ours with Tri-map · Flickr SoundNet test set, VGG-Sound144k trainingcIoU: 0.719 -> 0.687Hurt
Train on VGG-Sound10k instead of Flickr10kOurs · Flickr SoundNet test setcIoU: 0.582 -> 0.618Improved
Train on the full VGG-Sound set rather than VGG-Sound144kOurs · Flickr SoundNet test setcIoU: 0.719 -> 0.735Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy