AI Paper Atlas

Research map / Vision-language and multimodal / Human and embodied modeling

Improving Visual Grounding With Visual-Linguistic Verification and Iterative Reasoning

CVPR 2022 · Vision-language and multimodal › Human and embodied modeling · approach: Visual grounding transformers · 167 citations (OpenAlex)

Check your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use VLTVG instead of TransVGRefCOCO, RefCOCO+, RefCOCOg, ReferItGame, and Flickr30k Entities visual grounding · RefCOCO, RefCOCO+, RefCOCOg, ReferItGame, Flickr30k Entitiesaccuracy: 84.77 vs 81.02 (RefCOCO val, ResNet-101); 74.19 vs 64.82 (RefCOCO+ val, ResNet-101); 72.98 vs 67.02 (RefCOCOg val-g, ResHelped
Add multi-stage cross-modal reasoning instead of a single-stage decoder (ablation)VLTVG · RefCOCOg val-gaccuracy: 63.64 -> 66.02Helped
Add the language-guided context encoder (ablation)VLTVG with multi-stage decoder · RefCOCOg val-gaccuracy: 66.02 -> 68.44Helped
Add visual-linguistic verification (ablation)VLTVG with multi-stage decoder and context encoder · RefCOCOg val-gaccuracy: 68.44 -> 71.62 (+3.18 percentage points)Helped
Increase decoder stages from 1 to 2 (ablation)VLTVG decoder · RefCOCOg val-gaccuracy: 63.64 -> 65.05Helped
Increase decoder stages from 2 to 4 (ablation)VLTVG decoder · RefCOCOg val-gaccuracy: 65.05 -> 65.70Helped
Increase decoder stages from 4 to 6 (ablation)VLTVG decoder · RefCOCOg val-gaccuracy: 65.70 -> 66.02Helped
Increase decoder stages from 6 to 8 (ablation)VLTVG decoder · RefCOCOg val-gaccuracy: 66.02 -> 65.97Hurt
Replace verification and context modules with one transformer encoder layer (ablation)VLTVG feature learning · RefCOCOg val-gaccuracy: 66.02 -> 69.37Helped
Replace verification and context modules with two transformer encoder layers (ablation)VLTVG feature learning · RefCOCOg val-gaccuracy: 69.37 -> 69.22No clear effect
Replace verification and context modules with three transformer encoder layers (ablation)VLTVG feature learning · RefCOCOg val-gaccuracy: 69.37 -> 69.15No clear effect
Replace verification and context modules with four transformer encoder layers (ablation)VLTVG feature learning · RefCOCOg val-gaccuracy: 69.37 -> 69.55No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy