Research map / Video / Video segmentation and tracking
AllTracker: Efficient Dense Point Tracking at High Resolution
Adam W. Harley, Yang You, Xinglong Sun, Yang Zheng, Nikhil Raghuraman, Yunqi Gu, Sheldon Liang, Wen-Hsuan Chu, Achal Dave, Suya You, Rares Ambrus, Katerina Fragkiadaki and 1 more
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use transformer temporal module instead of MLP-Mixer (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 56.1 -> 56.8 | Improved |
| use transformer temporal module instead of ConvNext-1D (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 54.6 -> 56.8 | Improved |
| use transformer temporal module instead of Conv-1D (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 55.8 -> 56.8 | Improved |
| use motion relative to query frame (0->t) instead of adjacent frame (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 56.4 -> 56.8 | Improved |
| add sinusoidal embedding of motion (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 56.8 -> 54.8 | Hurt |
| use pretrained ConvNeXt backbone instead of scratch (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 54.9 -> 56.8 | Improved |
| use pretrained ConvNeXt instead of BasicEncoder (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 56.1 -> 56.8 | Improved |
| use 3 refinement blocks instead of 2 (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 55.7 -> 56.8 | Improved |
| use 3 refinement blocks instead of 4 (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 56.1 -> 56.8 | Improved |
| use correlation radius 4 instead of 5 (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 55.5 -> 56.8 | Improved |
| use L1 loss instead of Huber loss (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 54.9 -> 56.8 | Improved |
| train with ordered frames instead of shuffled (ablation) | AllTracker · Ablation validation set (6 datasets, Kubric 100k iters) | delta_avg: 56.3 -> 56.8 | Improved |
Closest papers by meaning
- Dense Optical Tracking: Connecting the Dots (CVPR 2024 · similarity 0.91)
- FlowTrack: Revisiting Optical Flow for Long-Range Dense Tracking (CVPR 2024 · similarity 0.90)
- SpatialTracker: Tracking Any 2D Pixels in 3D Space (CVPR 2024 · similarity 0.89)
- TrackIME: Enhanced Video Point Tracking via Instance Motion Estimation (NeurIPS 2024 · similarity 0.89)
- Track-On: Transformer-based Online Point Tracking with Memory (ICLR 2025 · similarity 0.88)
- TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking (NeurIPS 2026 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
