AI Paper Atlas

Research map / Benchmarks / MSR-VTT

MSR-VTT leaderboard

86 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR report results on MSR-VTT. Best CIDEr: 63.9 (STM, CVPR 2025).

Numbers are as each paper reports them, read by AI from its results tables and not checked by hand. Papers can differ in setting (training data, model size, extra data); the topic column shows what each paper is about. Open the paper before you compare or quote a number.

MSR-VTT · CIDEr

29 papers, each with its best reported number for its own method; higher is better.

19 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

MSR-VTT · BLEU-4

22 papers, each with its best reported number for its own method; higher is better.

12 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

MSR-VTT · FVD

21 papers, each with its best reported number for its own method; lower is better.

11 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

MSR-VTT · METEOR

21 papers, each with its best reported number for its own method; higher is better.

#METEOR ↑MethodPaperTopic
134.7MAMS + mPLUG-2
mPLUG-2
MAMS: Model-Agnostic Module Selection Framework for Video Captioning
AAAI 2025 · Main results table, MSRVTT
Video-language understanding
233.4MA-LMM
Vicuna-7B
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
CVPR 2024 · Table 4
Video-language understanding
333AdaCM2
InstructBLIP Q-Former, Vicuna-7B
AdaCM^2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction
CVPR 2025 · Table 3
Video-language understanding
431.1CLIP4VLA
CLIP ViT-B/32
Accommodating Audio Modality in CLIP for Multimodal Processing
AAAI 2023 · Table: Captioning Performance
Cross-modal learning
530.16dualAFR Soft Attention (Ensemble)
C3D
Adaptive Feature Abstraction for Translating Video to Text
AAAI 2018 · Table 2
Video-language understanding
629.9VSVCapLeveraging Weighted Cross-Graph Attention for Visual and Semantic Enhanced Video Captioning Network
AAAI 2023 · Table 5
Video-language understanding
729.7Ours
IRv2+C3D
Joint Syntax Representation Learning and Visual Cue Translation for Video Captioning
ICCV 2019 · Table 4
Video-language understanding
829.56PMI-CAP (with audio)
IRV2+C+A
Learning Modality Interaction for Temporal Sentence Localization and Event Captioning in Videos
ECCV 2020 · Table 4
Video-language understanding
929HMNHierarchical Modular Network for Video Captioning
CVPR 2022 · Table 1
Video-language understanding
1028.8ORG-TRLObject Relational Graph With Teacher-Recommended Learning for Video Captioning
CVPR 2020 · Table 1
Video-language understanding
11 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

MSR-VTT · CLIPSIM

20 papers, each with its best reported number for its own method; higher is better.

10 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

MSR-VTT · R@1

19 papers, each with its best reported number for its own method; higher is better.

#R@1 ↑MethodPaperTopic
159AMD-Net
CLIP ViT-B/16
Appearance-Motion Decomposed Alignment for Text-Video Retrieval
AAAI 2026 · Table 1
Video-language understanding
255.2TV-ProxyNet
CLIP-ViT-B/16
Text Proxy: Decomposing Retrieval from a 1-to-N Relationship into N 1-to-1 Relationships for Text-Video Retrieval
AAAI 2025 · Table 1
Video-language understanding
354.4InternVideo2-G+VISA
InternVideo2-G
Visual Abstraction: A Plug-and-Play Approach for Text-Visual Retrieval
ICML 2025 · Table 2
Human and embodied modeling
451.5VIDEO-COLBERT (SigLIP-B/16)
SigLIP-B/16
Video-ColBERT: Contextualized Late Interaction for Text-to-Video Retrieval
CVPR 2025 · Table 1
Video-language understanding
550.8vid-TLDR
UMT-B
vid-TLDR: Training Free Token Merging for Light-weight Video Transformer
CVPR 2024 · Table 2
Video segmentation and tracking
648.5STM
ViT-B/16
Video Language Model Pretraining with Spatio-temporal Masking
CVPR 2025 · Table 2
Video-language understanding
746.9STAN-self-B/32
CLIP-B/32
Revisiting Temporal Modeling for CLIP-Based Image-to-Video Knowledge Transferring
CVPR 2023 · Ablation table: Components
Video-language understanding
846.5VindLU
ViT-B/16
VindLU: A Recipe for Effective Video-and-Language Pretraining
CVPR 2023 · Retrieval results table
Video-language understanding
946.3SRTubeSRTube: Video-Language Pre-Training with Action-Centric Video Tube Features and Semantic Role Labeling
CVPR 2024 · Table 1
Video-language understanding
1044.7LamRA
Qwen2-VL-7B
LamRA: Large Multimodal Model as Your Advanced Retrieval Assistant
CVPR 2025 · Table 8
CLIP and zero-shot
9 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

MSR-VTT · FID

10 papers, each with its best reported number for its own method; lower is better.

Not affiliated with any conference, journal or the benchmark's authors. Corrections: contact@latenticlabs.com.