AI Paper Atlas

Research map / Benchmarks / MS-COCO 5K

MS-COCO 5K leaderboard

13 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR report results on MS-COCO 5K. Best rSum: 478.3 (Ours (GRM), AAAI 2026).

Numbers are as each paper reports them, read by AI from its results tables and not checked by hand. Papers can differ in setting (training data, model size, extra data); the topic column shows what each paper is about. Open the paper before you compare or quote a number.

MS-COCO 5K · rSum

13 papers, each with its best reported number for its own method; higher is better.

#rSum ↑MethodPaperTopic
1478.3Ours (GRM)
Swin-base-384 + BERT-base
Cross Modal Fine-grained Alignment via Granularity-aware and Region-uncertain Modeling
AAAI 2026 · Table 1
Human and embodied modeling
2453.8MP-ISMoE (SHERL)
VSE∞
MP-ISMoE: Mixed-Precision Interactive Side Mixture-of-Experts for Efficient Transfer Learning
AAAI 2026 · Table 1
Pruning and efficient tuning
3450.9HREM (Full)
Region + BERT
Learning Semantic Relationship Among Instances for Image-Text Matching
CVPR 2023 · Table 1
Cross-modal learning
4449.1D2S-VSE
ViT-Base-384 + BERT-base
Aligning Information Capacity Between Vision and Language via Dense-to-Sparse Feature Distillation for Image-Text Matching
ICCV 2025 · Table 1
Human and embodied modeling
5445.3UniPT
VSE∞
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory
CVPR 2024 · Table 3
Pruning and efficient tuning
6443.9CHAN
BUTD + BERT
Fine-Grained Image-Text Matching by Cross-Modal Hard Aligning Network
CVPR 2023 · Table 1
Human and embodied modeling
7439.8APSE-IPIK
CLIP ViT-B/32
Adaptive Prompt-Based Semantic Embedding with Inspire Potential of Implicit Knowledge for Cross-Modal Retrieval
AAAI 2025 · Table 2
Cross-modal learning
8439.2SGRAF + CUSA
SGRAF
Cross-Modal and Uni-Modal Soft-Label Alignment for Image-Text Retrieval
AAAI 2024 · Table 1
Cross-modal learning
9438.6CRCL
SGRAF
Cross-modal Active Complementary Learning with Self-refining Correspondence
NeurIPS 2023 · Table 2
Cross-modal learning
10434.4LAPS
ViT-Base-224 + BERT-base
Linguistic-Aware Patch Slimming Framework for Fine-grained Cross-Modal Alignment
CVPR 2024 · Table 1
Human and embodied modeling
3 more papers on this leaderboard, the baselines reported on it and a CSV download are free with a scime account.
Sign in free to see all

Not affiliated with any conference, journal or the benchmark's authors. Corrections: contact@latenticlabs.com.