AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

Adaptive Cross-Modal Embeddings for Image-Text Alignment

Jonatas Wehrmann, Camila Kolling, Rodrigo C Barros

AAAI 2020 · Vision-language and multimodal › Cross-modal learning · approach: Probabilistic embeddings for cross-modal retrieval · 90 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
ADAPT-T2I single model vs SCANimage-text alignment · Flickr30k testImage Retrieval R@1: 45.8 -> 57.0Improved
ADAPT-T2I vs SCAN-ensimage-text alignment · MS COCO 1k testImage Retrieval R@1: 58.8 -> 63.3Improved
add fovea module (ablation)ADAPT-T2I · Flickr30k valRsum: 478.2 -> 494.2Improved
add fovea module (ablation)ADAPT-I2T · Flickr30k valRsum: 427.4 -> 482.0Improved
increase fovea lambda from 1 to 10 (ablation)ADAPT-T2I · Flickr30k valRsum: 489.8 -> 494.2Improved
learn lambda by backprop instead of fixed 10 (ablation)ADAPT-T2I · Flickr30k valRsum: 494.2 -> 493.1No clear effect
add fixed GloVe to random trainable embeddings (ablation)ADAPT-T2I · Flickr30k valRsum: 484.1 -> 494.2Improved
fine-tune GloVe instead of keeping fixed (ablation)ADAPT-T2I · Flickr30k valRsum: 494.2 -> 492.3No clear effect
text-guided image adaptation (T2I) instead of image-guided text (I2T)ADAPT · Flickr30k testRsum: 484.8 -> 494.8Improved
ADAPT vs SCAN on retrieval timeimage-text alignment · Flickr30kspeed: same R@1 but 25x fasterImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy