AI Paper Atlas

Research map / Vision-language and multimodal / Multimodal LLMs

NAVIGATE: Evaluating Visual-Guided Search Decision-Making on the Open Web

YaoQi Fan, Zhe Chen, Zhu Wei, Kangxin Yin, Yangzhou Liu, Yue Cao, Zhi Zhu, Tong Lu

ICML 2026 · Vision-language and multimodal › Multimodal LLMs · approach: Multimodal LLM benchmarks

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces NAVIGATE, a benchmark for evaluating vision-language models on deciding when to search and how to steer open-web search from ambiguous or conflicting visual evidence.

Problem

VLMs deployed with web search tools lack benchmarks isolating whether they decide when to search and how to steer search from ambiguous visual evidence, especially with multiple overlapping or conflicting images.

Approach

A benchmark centered on images as primary evidence for open-web search planning, targeting search-decision capability under visual ambiguity and cross-image conflicts.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
enable web search for GPT-5GPT-5 · NAVIGATE overallaccuracy: 27.2% -> 33.3%Improved
enable web search for GPT-5.1GPT-5.1 · NAVIGATE overallaccuracy: 28.42% -> 34.11%Improved
enable search for Gemini-2.5 family (Flash-Search vs Pro without search)Gemini-2.5 · NAVIGATE overallaccuracy: 24.27% vs 25.10%No clear effect
enable web search on multi-domain questions (GPT-5)GPT-5 · NAVIGATE multi-domain questionsaccuracy: 16.42% -> 23.88%Improved
scale Qwen2.5-VL from 7B to 72BQwen2.5-VL-Instruct · NAVIGATE overallaccuracy: 10.88% -> 15.90%Improved
use thinking variant instead of instruct for Qwen3-VL-235BQwen3-VL-235B-A22B · NAVIGATE overallaccuracy: 16.84% -> 17.89%No clear effect
add search to models on single-image questionssearch-enabled VLMs · NAVIGATE single-image questionsaccuracyHurt
larger scale or stronger general multimodal abilityVLMs · NAVIGATE overallaccuracyNo clear effect

Experimental setup

Benchmarks: NAVIGATE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy