AI Paper Atlas

Research map / Video / Video-language understanding

Learning Fine-grained View-Invariant Representations from Unpaired Ego-Exo Videos via Temporal Alignment

Zihui Xue, Kristen Grauman

NeurIPS 2023 · Video › Video-language understanding · approach: Egocentric video understanding · 7 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add object-centric encoder to Base DTW (ablation)DTW alignment with ResNet-50 · Break EggsF1 score: 58.53 -> 62.86Improved
Add object-centric encoder to Base DTW (ablation)DTW alignment with ResNet-50 · Pour MilkF1 score: 82.91 -> 84.04Improved
Add object-centric encoder to Base DTW (ablation)DTW alignment with ResNet-50 · Pour LiquidF1 score: 59.66 -> 63.28Improved
Add object-centric encoder to Base DTW (ablation)DTW alignment with ResNet-50 · Tennis ForehandF1 score: 79.56 -> 84.14Improved
Add contrastive regularization on top of object-centric encoder (ablation)AE2 · Break EggsF1 score: 62.86 -> 66.23Improved
Add contrastive regularization on top of object-centric encoder (ablation)AE2 · Pour MilkF1 score: 84.04 -> 85.17Improved
Add contrastive regularization on top of object-centric encoder (ablation)AE2 · Pour LiquidF1 score: 63.28 -> 66.56Improved
Add contrastive regularization on top of object-centric encoder (ablation)AE2 · Tennis ForehandF1 score: 84.14 -> 85.87Improved
Add object-centric encoder to Base DTW (ablation)DTW alignment with ResNet-50 · Pour Liquidframe retrieval mAP@10: +10.83%Improved
Add object-centric encoder to Base DTW (ablation)DTW alignment with ResNet-50 · Tennis Forehandframe retrieval mAP@10: +5.57%Improved
Use random shuffle instead of temporal reverse for negative samples (ablation)AE2 · Break EggsF1 score: -5.62%Hurt
Use random shuffle instead of temporal reverse for negative samples (ablation)AE2 · Break Eggsframe retrieval mAP@10: 65.85 -> 61.66Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy