AI Paper Atlas

Research map / Detection and segmentation / Weakly supervised detection and segmentation

Self-Supervised Object Detection From Audio-Visual Correspondence

Triantafyllos Afouras, Yuki M. Asano, Francois Fagan, Andrea Vedaldi, Florian Metze

CVPR 2022 · Detection and segmentation › Weakly supervised detection and segmentation · approach: Weakly supervised detection · 53 citations (OpenAlex)

Check your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use audio-visual self-labels to train an image-only detector rather than relying on heatmap localizationSelf-supervised object detection · Object detection and sound source localization benchmarksmAPImproved
Use ground-truth video categories instead of self-generated class labelsOurs - weak sup. · VGGSound and AudioSetAP50: 3% AP50 dropImproved
Use 20 clusters rather than 39 (ablation)Ours · VGGSound instrumentsmAP50: 39.4 -> 34.4Hurt
Use 50 clusters rather than 39 (ablation)Ours · VGGSound instrumentsmAP50: 39.4 -> 41.0Improved
Use 50 clusters rather than 39 (ablation)Ours · OpenImages instrumentsmAP50: 28.5 -> 27.5Hurt
Replace Hungarian matching with argmax matching (ablation)Ours · VGGSound instrumentsmAP50: 39.4 -> 39.6No clear effect
Replace Hungarian matching with argmax matching (ablation)Ours · OpenImages instrumentsmAP50: 28.5 -> 30.1Improved
Use manual grouping instead of Hungarian matching (ablation)Ours · VGGSound instrumentsmAP50: 39.4 -> 41.0Improved
Use manual grouping instead of Hungarian matching (ablation)Ours · OpenImages instrumentsmAP50: 28.5 -> 29.5Improved
Align clusters with only 1 labelled example per cluster (ablation)Ours · VGGSound instrumentsmAP50: 39.4 -> 36.4Hurt
Align clusters with 10 labelled examples per cluster instead of 1 (ablation)Ours · VGGSound instrumentsmAP50: 36.4 -> 37.1Improved
Sample the box-threshold parameter beta from 0.7-0.9 instead of fixing it at 0.7 (ablation)Ours · VGGSound instrumentsmAP50: 39.4 -> 37.5Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy