AI Paper Atlas

Research map / Vision-language and multimodal / Multimodal LLMs

GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing

Yisong Xiao, Xianglong Liu, QianJia Cheng, Zhenfei Yin, Siyuan Liang, Jiapeng Li, Jing Shao, Aishan Liu, Dacheng Tao

IJCV 2025 · Vision-language and multimodal › Multimodal LLMs · approach: VLM capability analysis · 26 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
scale LLaVA1.5 LLM from 7B to 13BLLaVA1.5 · GenderBias-VL VL-BiasB_ovl: 1.85 -> 2.91Hurt
scale LLaVA1.5 LLM from 7B to 13BLLaVA1.5 · GenderBias-VL VL-BiasAcc: 52.15 -> 59.08Improved
upgrade LLaVA1.5-13B to LLaVA1.6-13B with larger training corpusLLaVA · GenderBias-VL VL-BiasB_ovl: 2.91 -> 3.29Hurt
upgrade LLaVA1.5-13B to LLaVA1.6-13B with larger training corpusLLaVA · GenderBias-VL VL-BiasAcc: 59.08 -> 67.70Improved
add RLHF to LLaVA1.5-13B (LLaVA-RLHF)LLaVA1.5-13B · GenderBias-VL VL-BiasB_ovl: 2.91 -> 4.15Hurt
add RLHF to LLaVA1.5-13B (LLaVA-RLHF)LLaVA1.5-13B · GenderBias-VL VL-BiasAcc: 59.08 -> 63.04Improved
compare commercial Gemini-Pro with GPT-4o on Top-10 biased pairsGemini-Pro · GenderBias-VL Top-10 pairsB^o_ovl: nearly 3 times the bias level of GPT-4oHurt
swap option orderLLaVA1.5 models · GenderBias-VLDelta Acc: 96.24 and 89.33 average Delta Acc for LLaVA1.5 and LAv2Hurt
use CLIP image encoder alone instead of the LVLM built on itCLIP vs LVLMs · GenderBias-VL V-BiasB^o_ovl: CLIP 9.11 vs LLaVA1.5-7B 0.85Mixed
compare visual vs language modality biasLVLMs · GenderBias-VLB_micro correlation: rho 0.77 and tau 0.60No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy