AI Paper Atlas

Research map / Video / Video segmentation and tracking

Exploring Motion and Appearance Information for Temporal Sentence Grounding

Daizong Liu, Xiaoye Qu, Pan Zhou, Yang Liu

AAAI 2022 · Video › Video segmentation and tracking · approach: Stochastic video prediction · 40 citations (OpenAlex)

Read the paper

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use MARN with motion and object features instead of the strongest proposal-based baseline CBLNMARN · Charades-STA (official split)R@1, IoU=0.7: 38.22 -> 43.09Improved
Use MARN with motion and object features instead of CBLNMARN · TACoS (official split)R@1, IoU=0.5: 27.65 -> 35.74Improved
Replace C3D motion features with I3D featuresMARN · Charades-STA (official split)R@1, IoU=0.7: 43.09 -> 44.80Improved
Replace C3D motion features with I3D featuresMARN · TACoS (official split)R@1, IoU=0.5: 35.74 -> 37.25Improved
Add the appearance branch (ablation)MARN baseline · Charades-STAR@1, IoU=0.7: 34.76 -> 37.20Improved
Add the motion encoder (ablation)MARN with appearance branch · Charades-STAR@1, IoU=0.7: 37.20 -> 38.91Improved
Add the motion branch (ablation)MARN with appearance branch and motion encoder · Charades-STAR@1, IoU=0.7: 38.91 -> 40.85Improved
Add the motion-appearance associating module (ablation)MARN with appearance and motion branches · Charades-STAR@1, IoU=0.7: 40.85 -> 43.09Improved
Remove global frame features (ablation)MARN · Charades-STAR@1, IoU=0.7: 43.09 -> 41.46Hurt
Remove position encoding (ablation)MARN · Charades-STAR@1, IoU=0.7: 43.09 -> 40.73Hurt
Use concatenation instead of attention for cross-modal interaction (ablation)MARN reasoning branch · Charades-STAR@1, IoU=0.7: 43.09 -> 41.62Hurt
Remove the spatio-temporal graph (ablation)MARN reasoning branch · Charades-STAR@1, IoU=0.7: 43.09 -> 41.38Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy