AI Paper Atlas

Research map / Video / Action recognition

Trajectory-aligned Space-time Tokens for Few-shot Action Recognition

Pulkit Kumar, Namitha Padmanabhan, Luke Luo, Sai Saketh Rambhatla, Abhinav Shrivastava

ECCV 2024 · Video › Action recognition · approach: Disentangled action recognition · 9 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add point trajectories (uniform temporal re-initialization) to DINO tokens (ablation)TATs · Kinetics 5-way 1-shotaccuracy (%): 80.2 -> 81.9Improved
initialize points only in first frame instead of no points (ablation)TATs · Kinetics 5-way 1-shotaccuracy (%): 80.2 -> 78.6Hurt
reinitialize points uniformly over time instead of first frame only (ablation)TATs · SSv2-Full 5-way 1-shotaccuracy (%): 56.0 -> 57.7Improved
increase sampled points from 32 to 256 (ablation)TATs · SSv2-Full 5-way 1-shotaccuracy (%): 53.4 -> 57.7Improved
halve points from 256 to 128 (ablation)TATs · Kinetics 5-way 1-shotaccuracy (%): 81.9 -> 81.6No clear effect
increase grid size from 16x16 to 25x25 (ablation)TATs · SSv2-Full 5-way 1-shotaccuracy (%): 57.7 -> 58.1No clear effect
reduce grid size to 9x9 (ablation)TATs · SSv2-Full 5-way 1-shotaccuracy (%): 57.7 -> 56.0Hurt
swap CoTrackerV2 for TAPIR or PIPS++ (ablation)TATs · SSv2-Full 5-way 1-shotaccuracy (%): 57.7 -> 56.9 (TAPIR), 57.3 (PIPS++)No clear effect
use trajectory length or HOD sampling instead of random sampling (ablation)TATs · SSv2-Full 5-way 1-shotaccuracy (%): 57.7 -> 57.4 (length), 57.1 (HOD)No clear effect
add point trajectories on top of DINO tokens (ablation)TATs · FineGym 1-shotaccuracy (%): 77.6 -> 81.8Improved
use TATs instead of MoLo on HMDB-51TATs · HMDB-51 5-way 1-shotaccuracy (%): 65.1 -> 60.0 (vs CCLN)Hurt
use only 2 input framesTATs · SSv2-Full 5-way 1-shotaccuracy (%)Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy