AI Paper Atlas

Research map / Video / Action recognition

A Large-scale Study of Spatiotemporal Representation Learning with a New Benchmark on Action Recognition

Andong Deng, Taojiannan Yang, Chen Chen

ICCV 2023 · Video › Action recognition · approach: Disentangled action recognition · 15 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
compare 2D CNN (TSM) with transformers under a matched ConvNeXt backbonevideo action recognition models · BEAR 18 datasets (supervised)macro-average accuracy: TSM 68.10 vs VideoSwin 66.48 and TimeSformer 64.27Improved
use self-supervised instead of supervised Kinetics-400 pre-training (ablation)TSM and others · BEAR 18 datasetsmacro-average accuracy: 68.10 -> 63.35 (TSM)Hurt
use self-supervised instead of supervised pre-training on WLASL (ablation)3D Non-local network · WLASL100accuracy: 52.31 -> 30.56Hurt
evaluate with large viewpoint shift from Kinetics-400 (drone, egocentric, CCTV)fine-tuned video models · UCF-Crime, UAV-Human, CharadesEgo, MECCANOaccuracyHurt
few-shot instead of full-data fine-tuning (ablation)video models · BEAR few-shot (2,4,8,16-shot)accuracyHurt
replace supervised pre-training by SoTA self-supervised VideoMAE in few-shotvideo models · BEAR few-shotaccuracyNo clear effect
apply UDA methods (TA3N, CoMix) under viewpoint shiftToyota Smarthome to MPII-Cooking · BEAR UDAaccuracy: 5.32 -> 12.63 vs supervised target 70.21Mixed
use ActionCLIP (Kinetics-400 fine-tuned) instead of CLIP for zero-shotzero-shot evaluation · BEAR zero-shotaccuracyHurt
use NAS-based X3D versus manually designed modelsvideo models · BEAR 18 datasetsmacro-average accuracy: 61.39 vs TSM 68.10Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy