AI Paper Atlas

Research map / Video / Video segmentation and tracking

The Visual Centrifuge: Model-Free Layered Video Representations

Jean-Baptiste Alayrac, Joao Carreira, Andrew Zisserman

CVPR 2019 · Video › Video segmentation and tracking · approach: Layered video decomposition and dynamics · 1 citations (OpenAlex)

Check your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Train the predictor with permutation-invariant reconstruction loss instead of leaving it untrainedPredictor · Kinetics-600 val, blended video pairsvalidation loss: 0.561 -> 0.187Improved
Add a correction module to the predictor (ablation)Predictor, 4 output layers · Kinetics-600 val, blended video pairsvalidation loss: 0.159 -> 0.133Improved
Increase the number of output layers from 2 to 4 (ablation)Predictor · Kinetics-600 val, blended video pairsvalidation loss: 0.187 -> 0.159Improved
Increase the number of output layers from 4 to 8 or 12 (ablation)Predictor · Kinetics-600 val, blended video pairsvalidation loss: 0.159 -> 0.151; 0.159 -> 0.150No clear effect
Add a recomposition-consistency loss (ablation)Video layer separation model · Kinetics-600 blended video pairsreconstruction performanceNo clear effect
Add an explicit diversity loss between output layers (ablation)Video layer separation model · Kinetics-600 blended video pairsreconstruction performanceNo clear effect
Unmix blended videos before action recognitionI3D action classifier · Kinetics-600 val, blended video pairstwo-label action accuracy: 22% -> 44%Improved
Train on frozen videos without motion rather than normal videos (ablation)Predictor-Corrector · Kinetics-600 val, two frozen videosvalidation loss: 0.205 -> 0.165Improved
Train on frozen videos without motion rather than normal videos (ablation)Predictor-Corrector · Kinetics-600 val, two normal videosvalidation loss: 0.133 -> 0.233Hurt
Use a deeper encoder endpoint, Mixed_4f or Mixed_5c, instead of Mixed_3c (ablation)Predictor · Kinetics-600 val, blended video pairsvalidation loss: 0.214 -> 0.181; 0.214 -> 0.187Improved
Separate same-class video pairs rather than random pairs (ablation)Predictor-Corrector · Kinetics-600, same-action-class pairsaverage reconstruction loss: 0.133 -> 0.145Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy