AI Paper Atlas

Research map / Vision-language and multimodal / Multimodal LLMs

Beyond Final Answers: CRYSTAL Benchmark for Transparent Multimodal Reasoning Evaluation

Wayner Barrios, SouYoung Jin

ECCV 2026 · Vision-language and multimodal › Multimodal LLMs · approach: Chain-of-thought multimodal reasoning · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train with CPR-Curriculum via GRPOQwen2.5-VL-3B · CRYSTAL testMatch F1: 0.480 -> 0.633Improved
train with CPR-Curriculum via GRPOQwen2.5-VL-3B · CRYSTAL testaccuracy (%): 39.85 -> 47.52Improved
train with CPR-Curriculum via GRPOInternVL3.5-4B · CRYSTAL testMatch F1: 0.432 -> 0.833Improved
train with CPR-Curriculum via GRPOInternVL3.5-4B · CRYSTAL testaccuracy (%): 37.61 -> 45.76Improved
train with CPR-Curriculum via GRPOQwen2.5-VL-3B · CRYSTAL testLIS: 0.723 -> 0.626Hurt
replace additive Composite reward with multiplicative CPR (ablation)Qwen2.5-VL-3B GRPO · CRYSTAL testMatch F1: 0.426 -> 0.633Improved
replace Answer-Only reward with multiplicative CPR (ablation)Qwen2.5-VL-3B GRPO · CRYSTAL testMatch F1: 0.429 -> 0.633Improved
replace Composite reward with CPR (ablation)Qwen2.5-VL-3B GRPO · CRYSTAL testaccuracy (%): 44.92 -> 41.40Hurt
add curriculum (answer-only warm-up, difficulty schedule) to CPR (ablation)Qwen2.5-VL-3B GRPO · CRYSTAL testaccuracy (%): 41.40 -> 47.52Improved
add curriculum to CPR (ablation)Qwen2.5-VL-3B GRPO · CRYSTAL testMatch F1: 0.633 -> 0.633No clear effect
set reward weights a_w=0.65, s_w=0.35 instead of a_w=0.80, s_w=0.20 (ablation)CPR · held-out valaccuracy (%): 81.79 -> 82.70Improved
set reward weights a_w=0.65, s_w=0.35 instead of a_w=0.20, s_w=0.80 (ablation)CPR · held-out valaccuracy (%): 74.81 -> 82.70Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy