AI Paper Atlas

Research map / Vision-language and multimodal / Visual question answering

MMClima: A Framework for Multimodal Climate Science Data and Evaluation

Muhammad Umer Sheikh, Hassan Abid, Khawar shehzad, Ufaq Khan, Muhammad Haris Khan

ICML 2026 · Vision-language and multimodal › Visual question answering · approach: Open-domain multimodal QA · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
fine-tune Llama 3.3 70B with LoRA on MMClima training splitLlama-3.3-70B-Instruct · MMClima textual QAweighted overall score: 71.42 -> 78.24Improved
fine-tune Llama 3.3 70B on MMClimaLlama-3.3-70B-Instruct · MMClima textual QA MCQaccuracy: 80.26 -> 89.54Improved
fine-tune Llama 3.3 70B on MMClimaLlama-3.3-70B-Instruct · MMClima textual QA Clozescore: 45.56 -> 49.72Improved
fine-tune Llama 3.3 70B on MMClimaLlama-3.3-70B-Instruct · MMClima textual QA FreeformBERTScore: 88.43 -> 95.47Improved
fine-tune Llama 3.3 70B on MMClimaLlama-3.3-70B-Instruct · MMClima freeform QALLM judge accuracy: 45.48 -> 52.29Improved
use YouTube transcript questions instead of Wikipedia text questions (ablation)mmclima_70b_txt · MMClima textual QAoverall (unweighted mean): 78.08 -> 80.17Improved
use YouTube transcript questions instead of Wikipedia text questions (ablation)mistral-7b-instruct · MMClima textual QA MCQaccuracy: 32.62 -> 52.26Improved
use YouTube transcript questions instead of Wikipedia text questions (ablation)gpt-5-nano · MMClima textual QA Freeformaccuracy: 87.78 -> 88.33No clear effect
use closed-source GPT-5 instead of open-source Pixtral-LargeVLM · MMClima VQAweighted overall score: 68.53 -> 71.94Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy