AI Paper Atlas

Research map / Vision-language and multimodal / Visual question answering

Emergent Communication in Interactive Sketch Question Answering

Zixing Lei, Yiming Zhang, Yuxin Xiong, Siheng Chen

NeurIPS 2023 · Vision-language and multimodal › Visual question answering · approach: Visual reasoning diagnostics · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train on sketches instead of RGB images (MCAN) (ablation)MCAN · VQAv2 sketchoverall accuracy: 40.86 -> 54.58Improved
sketch-based MCAN vs RGB-based MCAN on RGB data (upper bound)MCAN · VQAv2overall accuracy: 64.74 -> 54.58Hurt
train Faster-RCNN on sketches instead of RGB (ablation)Faster-RCNN · sketch-VGmAP@50: 0.003 -> 0.034Improved
train Faster-RCNN on sketches instead of RGB (ablation)Faster-RCNN · sketch-VGweighted mAP@50: 0.010 -> 0.085Improved
sketch-trained detector evaluated on RGB vs RGB-trained detectorFaster-RCNN · VG RGBmAP@50: 0.082 -> 0.034Hurt
use PraGeo (a=0.5) instead of Pragmatic (a=0)sender · Human interpretabilityCLIP distance: 0.9077 -> 0.1815Improved
use PraGeo instead of Pragmaticsender · Human interpretabilityhuman score (lower better): 0.998 -> 0.600Improved
use Geometric instead of PraGeosender · Human interpretabilityCLIP distance: 0.1815 -> 0.1193Improved
use Pragmatic instead of Geometric at low drawing complexity (B < 0.3N)sender · VQAv2 sketchesanswer accuracyImproved
use Geometric/other models at high complexity (B > 0.3N)sender · VQAv2 sketchesanswer accuracyNo clear effect
add multi-round interactive feedback (ablation)PraGeo · VQAv2 sketchesanswer accuracyImproved
go from two-round to three-round interaction (ablation)PraGeo · VQAv2 sketchesanswer accuracyNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy