AI Paper Atlas

Research map / 3D vision / 3D generation

Learning Viewpoint-Agnostic Visual Representations by Recovering Tokens in 3D Space

Jinghuan Shang, Srijan Das, Michael S Ryoo

NeurIPS 2022 · 3D vision › 3D generation · approach: 2D-to-3D pretrained representations · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add 3DTRLSwin-T · Pouring video alignmentKendall's tau: 0.584 -> 0.683Improved
add 3DTRLSwin-T · CIFAR-100accuracy: 21.53 -> 21.55No clear effect
add 3DTRLTnT-S · CIFAR-100accuracy: 54.07 -> 56.00Improved
add 3DTRLTimeSformer · Smarthome CV2 mPAmPA: 27.5 -> 34.0Improved
pre-train 3DTRL on K400 versus random initTimeSformer + 3DTRL · Smarthome CV2accuracy: 69.5 -> 71.9Improved
use joint-temporal (single camera) instead of per-frame camera estimation (ablation)TimeSformer + 3DTRL · Smarthome CV2accuracy: 62.9 -> 58.6Hurt
use joint-temporal camera estimation with K400 pre-training (ablation)TimeSformer + 3DTRL · Smarthome CV2accuracy: 71.9 -> 68.2Hurt
add perspective augmentation instead of 3DTRL (ablation)DeiT · Pick video alignmentKendall's tau: 0.244 -> -0.249Hurt
add 3DTRLDeiT · Pick video alignmentKendall's tau: 0.244 -> 0.635Improved
use multiple 3DTRL modules (layers 4, 6, 8) (ablation)DeiT-T + 3DTRL · CIFAR-10accuracy: 78.8 -> 79.5Improved
disable Mixup and CutMix (ablation)DeiT-T · ImageNet-1K-Perturbedaccuracy: 61.3 -> 54.5Hurt
disable Mixup and CutMix (ablation)DeiT-T + 3DTRL · ImageNet-1K-Perturbedaccuracy: 64.6 -> 63.0Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy