Research map / Vision-language and multimodal / Human and embodied modeling
Knowing When to Look: Adaptive Attention via a Visual Sentinel for Image Captioning
Check your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add a visual sentinel and sentinel gate to spatial attention (ablation) | Ours-Spatial · Flickr30k | CIDEr: 0.493 to 0.531 | Helped |
| add a visual sentinel and sentinel gate to spatial attention (ablation) | Ours-Spatial · MS-COCO | CIDEr: 1.029 to 1.085 | Helped |
| add a visual sentinel and sentinel gate to spatial attention (ablation) | Ours-Spatial · MS-COCO | localization accuracy: 0.362 to 0.373 | Helped |
| use adaptive attention instead of spatial attention | image captioning · COCO test server | CIDEr c40 | Helped |
Closest papers by meaning
- Text-Guided Attention Model for Image Captioning (AAAI 2017 · similarity 0.90)
- Look Back and Predict Forward in Image Captioning (CVPR 2019 · similarity 0.90)
- Visual Attention Never Fades: Selective Progressive Attention ReCalibration for Detailed Image Captioning in Multimodal Large Language Models (ICML 2025 · similarity 0.88)
- A-VL: Adaptive Attention for Large Vision-Language Models (AAAI 2025 · similarity 0.86)
- Revisiting the Role of Language Priors in Vision-Language Models (ICML 2024 · similarity 0.85)
- Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning (ICLR 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.