AI Paper Atlas

Research map / Video / Video segmentation and tracking

Co-Separating Sounds of Visual Objects

Ruohan Gao, Kristen Grauman

ICCV 2019 · Video › Video segmentation and tracking · approach: Self-supervised video representation learning · 200 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add duet (multi-source) videos to solo training dataCo-Separation · MUSIC testSDR: 7.38 -> 7.64Improved
add duet (multi-source) videos to solo training dataSound-of-Pixels · MUSIC testSDR: 7.30 -> 6.05Hurt
add duet videos to solo training dataAV-Mix-and-Separate · MUSIC testSDR: 3.16 -> 3.23No clear effect
use co-separation training instead of video-level mix-and-separatesame separator network · MUSIC test (solo + duet)SDR: 3.23 -> 7.64Improved
use co-separation training instead of Sound-of-PixelsSound-of-Pixels baseline · AudioSet-SingleSourceSDR: 1.66 -> 4.26Improved
use co-separation on noisy AudioSet instead of AV-Mix-and-SeparateAV-Mix-and-Separate · AudioSet-SingleSourceSDR: 1.68 -> 4.26Improved
co-separation training for objects never heard individually (Violin/Saxophone)Sound-of-Pixels · Unseen-solo toy testSDR: 1.52 -> 8.10Improved
co-separation training for Violin/Guitar mixtureSound-of-Pixels · Unseen-solo toy testSDR: 6.95 -> 10.6Improved
co-separation training for Saxophone/Guitar mixtureSound-of-Pixels · Unseen-solo toy testSDR: 0.57 -> 5.08Improved
co-separation versus artifact-free baselines on SARCo-Separation · AudioSet / MUSICSAR: SAR 13.0 vs 12.2 on AudioSet; 10.8 vs 11.9 on MUSIC soloMixed
co-separation versus AV-MIML on denoisingCo-Separation · AV-Bench Wooden HorseNSDR: 12.3 -> 14.5Improved
co-separation versus AV-Loc on Guitar Solo denoisingCo-Separation · AV-Bench Guitar SoloNSDR: 14.1 vs 11.9Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy