AI Paper Atlas

Research map / Video / Video segmentation and tracking

Semantics Meets Temporal Correspondence: Self-supervised Object-centric Learning in Videos

Rui Qian, Shuangrui Ding, Xian Liu, Dahua Lin

ICCV 2023 · Video › Video segmentation and tracking · approach: Mask propagation for unsupervised video segmentation · 14 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add masked instance-identification stage after the semantic stage (ablation)SMTC · DAVIS-2017-UnsupervisedJ&F: 24.5 -> 40.5Improved
add semantic decomposition stage before instance identification (ablation)SMTC · DAVIS-2016IoU: 52.1 -> 71.8Improved
increase number of Gaussian distributions N from 1 to 16 (ablation)SMTC · DAVIS-2016IoU: 47.4 -> 71.8Improved
increase N from 16 to 32 (ablation)SMTC · DAVIS-2016IoU: 71.8 -> 71.9No clear effect
fuse correlation map with RGB features instead of RGB only (ablation)SMTC · DAVIS-2017-UnsupervisedJ&F: 20.1 -> 40.5Improved
add semantic stage to correlation-only input (ablation)SMTC · DAVIS-2016IoU: 59.4 -> 38.8Hurt
add semantic mask regularization L_reg (ablation)SMTC · DAVIS-2016IoU: 61.3 -> 66.4Improved
add instance consistency loss L_obj (ablation)SMTC · DAVIS-2017-UnsupervisedJ&F: 24.5 -> 40.5Improved
increase sampling frame rate from 2 to 4 FPS (ablation)SMTC · DAVIS-2016IoU: 66.3 -> 71.8Improved
increase frames per clip from 4 to 8 (ablation)SMTC · DAVIS-2016IoU: 71.8 -> 71.9No clear effect
query slot initialization instead of random sampling on correlation mapslot attention on DINO features · DAVIS-2016IoU: 56.3 -> 21.5Hurt
random sampling instead of query slot initialization on RGB featuresslot attention on DINO features · DAVIS-2016IoU: 58.1 -> 38.4Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy