Research map / Vision-language and multimodal / Visual question answering
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning
Pan Lu, Liang Qiu, Jiaqi Chen, Tony Xia, Yizhou Zhao, Wei Zhang, Zhou Yu, Xiaodan Liang, Song-Chun Zhu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Pre-train the ResNet backbone on icon classification rather than natural images (ablation) | Patch-TRM · IconQA validation | accuracy: 0.95-2.49% | Improved |
| Add cross-modal attention instead of simple concatenation (ablation) | Patch-TRM · IconQA validation | accuracy: up to 7% | Improved |
| Add positional embeddings for ordered diagram patches (ablation) | Patch-TRM · IconQA validation | accuracy | Improved |
| Use patch features rather than the vision [CLS] output as the diagram feature (ablation) | Patch-TRM · IconQA validation | accuracy | Improved |
| Use the full pyramid patch set rather than coarse-grained patch cropping (ablation) | Patch-TRM · IconQA validation | accuracy: 0.51% to 7.79% | Improved |
Closest papers by meaning
- GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answering (CVPR 2019 · similarity 0.90)
- InfoChartQA: A Benchmark for Multimodal Question Answering on Infographic Charts (NeurIPS 2025 · similarity 0.89)
- VTQA: Visual Text Question Answering via Entity Alignment and Cross-Media Reasoning (CVPR 2024 · similarity 0.88)
- ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models (NeurIPS 2025 · similarity 0.88)
- When Open-Vocabulary Visual Question Answering Meets Causal Adapter: Benchmark and Approach (AAAI 2025 · similarity 0.88)
- Visual Graph Arena: Evaluating Visual Conceptualization of Vision and Multimodal Large Language Models (ICML 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
