AI Paper Atlas

Research map / Vision-language and multimodal / Multimodal LLMs

VisNec: Measuring and Leveraging Visual Necessity for Multimodal Instruction Tuning

Mingkang Dong, Hongyi Cai, jie li, Sifan Zhou, Bin Ren, Kunyu Peng, Yuqian Fu

ECCV 2026 · Vision-language and multimodal › Multimodal LLMs · approach: Visual instruction tuning · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
select data with VisNec (blind vs multimodal loss difference plus clustering) instead of randomLLaVA-v1.5-7B 15% subset · LLaVA-665Krelative performance: 94.2% -> 100.2%Improved
select data with VisNec instead of randomLLaVA-v1.5-7B 15% subset · Vision-Flan-186Krelative performance: 96.7% -> 115.8%Improved
apply VisNec selection instead of random on Qwen2.5-VL-3BQwen2.5-VL-3B 98K subset · LLaVA-665Krelative performance: 98.8% -> 103.8%Improved
apply VisNec selection instead of random on Qwen2.5-VL-7BQwen2.5-VL-7B 98K subset · LLaVA-665Krelative performance: 98.7% -> 104.0%Improved
apply VisNec selection instead of random on Qwen2.5-VL-32BQwen2.5-VL-32B 98K subset · LLaVA-665Krelative performance: 97.9% -> 102.4%Improved
use the loss difference (blind minus multimodal) instead of text-only loss alone (ablation)VisNec · LLaVA-665K 15%relative performance: 95.6% -> 100.2%Improved
use the loss difference instead of multimodal loss alone (ablation)VisNec · LLaVA-665K 15%relative performance: 94.0% -> 100.2%Improved
add semantic clustering (K=20) before intra-cluster top-r% selection (ablation)VisNec · LLaVA-665K 15%relative performance: 97.0% -> 100.2%Improved
vary number of clusters k from 10 to 30 (ablation)VisNec · LLaVA-665K 15%relative performance: fluctuates within 1.3%, over 98.9%No clear effect
increase selection ratio from 15% to 20% (ablation)VisNec · LLaVA-665Krelative performance: 100.2% -> 99.2%Hurt
reduce selection ratio to 5% (ablation)VisNec · LLaVA-665Krelative performance: 100.2% -> 99.1%Mixed
use VisNec instead of Self-Filter selection for costVisNec · LLaVA-665Kselection time: 73.5 GPU-hr -> 12.0 GPU-hrImproved

Earlier methods this paper compares with

Named baselines from earlier accepted papers in this paper's results tables: better than 1 of 1 on most shared results.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy