AI Paper Atlas

Research map / Vision-language and multimodal / Visual question answering

ChartR: Evaluating Reasoning Accuracy and Robustness in Chart Question Answering

Xiaojun Chen, Sixiao Luo, Ziqi Liu, Min Yang, Qin Zhang, Liang-Jie Zhang

CVPR 2026 · Vision-language and multimodal › Visual question answering · approach: Open-domain multimodal QA

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
remove numeric annotations from the chart (ablation)Gemini-2.0-flash · ChartRISA / CFA: ISA 88.94 -> 62.50; CFA 54.50 -> 28.00Hurt
remove numeric annotations from the chart (ablation)Qwen2.5-VL-7B · ChartRISA / CFA: ISA 77.72 -> 54.61; CFA 32.00 -> 15.50Hurt
add Gaussian noise to the chart (ablation)Gemini-2.0-flash · ChartRISA: 88.94 -> 89.19No clear effect
add blur to the chart (ablation)Qwen2.5-VL-7B · ChartRISA: 77.72 -> 76.99No clear effect
add watermark to the chart (ablation)Phi-4-multimodal-5.6B · ChartRISA / CFA: 63.46 -> 60.17; CFA 7.50 -> 5.00No clear effect
require all reasoning steps correct (CFA) instead of final answer only (FAA)InternVL2.5-8B · ChartRaccuracy: 43.20 -> 8.90Hurt
require chained step correctness (CSA) instead of isolated step correctness (ISA)Gemini-2.0-flash · ChartRaccuracy: 83.01 -> 63.29Hurt
use chart-specialized models instead of general-purpose modelsTinyChart-3B / ChartGemma-2.4B · ChartRISA / CFA: ISA 28.29 / CFA 0.30 (TinyChart); ISA 27.78 / CFA 0.00 (ChartGemma) vs Gemini 83.01 / 50.60Hurt
correct preceding Value Extraction errorsGemini-2.0-flash · ChartRrecovery rate of VC errors: RecR 95.45%Improved
correct preceding Value Extraction errorsQwen2.5-VL-7B · ChartRrecovery rate of NC errors: RecR 94.30%Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy