AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

Vision-Language Pre-Training With Triple Contrastive Learning

Jinyu Yang, Jiali Duan, Son Tran, Yi Xu, Sampath Chanda, Liqun Chen, Belinda Zeng, Trishul Chilimbi, Junzhou Huang

CVPR 2022 · Vision-language and multimodal › Cross-modal learning · approach: Contrastive vision-language alignment · 290 citations (OpenAlex)

Check your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add intra-modal contrastive learning without stronger image augmentation (ablation)CMA+ITM+MLM · MSCOCO zero-shot text retrievalR@1: 68.7 -> 71.1Improved
Use two strongly augmented image views for IMC instead of the no-augmentation variant (ablation)TCL with IMC · MSCOCO zero-shot image retrievalR@1: 52.2 -> 53.3Improved
Add local MI maximization to CMA+IMC (ablation)TCL with IMC · Flickr30K zero-shot image retrievalR@1: 78.9 -> 79.6Improved
Add local MI maximization to CMA+IMC (ablation)TCL with IMC · MSCOCO zero-shot text retrievalR@1: 71.4 -> 71.4No clear effect
Pool last-layer image patch embeddings for LMI (ablation)TCL with LMI · Flickr30K zero-shot image retrievalR@1: 79.2 -> 79.6Improved
Use intermediate-layer local features rather than last-layer features (ablation)TCL with LMI · Flickr30K zero-shot text retrievalR@1: 92.4 -> 91.5Hurt
Increase pre-training data from 4M to 14M (ablation)TCL with IMC (w/o aug) · Flickr30K fine-tuned image retrievalR@1: 82.9 -> 86.0Improved
Set momentum coefficient to 0.5 (ablation)TCL · Downstream image-text retrievalperformanceImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy