AI Paper Atlas

Research map / Vision-language and multimodal / Visual question answering

Attention in Reasoning: Dataset, Analysis, and Modeling

Shi Chen, Ming Xin Jiang, Jinhui Yang, Qi Zhao

TPAMI 2021 · Vision-language and multimodal › Visual question answering · approach: Vision-language model VQA evaluation · 13 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add AiR-M progressive attention and reasoning supervisionUpDown · GQA test-devaccuracy: 51.31 -> 53.46Improved
add AiR-M supervisionBAN · GQA test-devaccuracy: 50.14 -> 53.36Improved
supervise attention with PAAN adversarial learningUpDown · GQA test-devaccuracy: 51.31 -> 48.03Hurt
supervise attention with HAN human-like attentionUpDown · GQA test-devaccuracy: 51.31 -> 49.96Hurt
add attention supervision with ASMMUTAN · GQA test-devaccuracy: 50.78 -> 51.46Improved
add attention loss (L_alpha) to AiR-M reasoning supervision (ablation)AiR-M · GQA test-devaccuracy: 50.01 -> 53.46Improved
add reasoning-operation loss (L_r) to AiR-M attention supervision (ablation)AiR-M · GQA test-devaccuracy: 50.33 -> 53.46Improved
use multi-step progressive supervision instead of single aggregated attention (ablation)AiR-M · GQA test-devaccuracy: 52.84 -> 53.46Improved
add incorrect-attention supervision on top of correct attention (AiR-C) (ablation)UpDown · GQA test-devaccuracy: 52.96 -> 53.74Improved
add incorrect-attention supervision on top of correct attention (AiR-C) (ablation)UpDown-360 · IQVAaccuracy: 40.55 -> 41.10Improved
add incorrect-attention supervision on top of correct attention (AiR-C) (ablation)UpDown · GQAAiR-E: 1.74 -> 2.02Improved
replace model attention with random attention (ablation)pre-trained UpDown · GQAaccuracy change: -7.39%Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy