AI Paper Atlas

Research map / Vision-language and multimodal / Human and embodied modeling

Multi-Level Multimodal Common Semantic Space for Image-Phrase Grounding

CVPR 2019 · Vision-language and multimodal › Human and embodied modeling · approach: Visual grounding transformers · 72 citations (OpenAlex)

Check your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the proposed multilevel attention and common-space method rather than the strongest listed prior baselinePhrase grounding · VisualGenome testpointing game accuracy: 30.03 -> 55.16Helped
Use the proposed multilevel attention and common-space method rather than the strongest listed prior baselinePhrase grounding · Flickr30k testpointing game accuracy: 50.10 -> 69.19Helped
Use the proposed multilevel attention and common-space method rather than the strongest listed prior baselinePhrase grounding · ReferIt testpointing game accuracy: 39.98 -> 62.76Helped
Add multilevel visual features with learned level selection instead of fixed middle/last layers (ablation)Full model · Flickr30kpointing game accuracy: 62.67 -> 67.73Helped
Add nonlinear mapping for both text and visual features instead of linear mappings (ablation)Common-space model · Flickr30kpointing game accuracy: 54.75 -> 67.73Helped
Add nonlinear visual mapping rather than using a linear visual mapping (ablation)Common-space model with ELMo and fixed-level features · Flickr30kpointing game accuracy: 56.92 -> 62.67Helped
Add nonlinear text mapping rather than using a linear text mapping (ablation)Common-space model with ELMo and fixed-level features · Flickr30kpointing game accuracy: 58.40 -> 62.67Helped
Use pretrained contextualized ELMo embeddings instead of a trainable BiLSTM (ablation)Phrase grounding model · Flickr30kpointing game accuracy: 61.13 -> 67.73Helped
Avoid softmax on attention heatmaps (ablation)Phrase grounding attention · Flickr30kpointing game accuracy: 47.20 -> 62.67Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy