AI Paper Atlas

Research map / Vision-language and multimodal / Multimodal LLMs

ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark

Joel Julin, Souraja Kundu, Liza Dahiya, George Z Wei, Louise Xie, Jingru Yi, Xu Zhang, Hao Yang, László Jeni

NeurIPS 2026 · Vision-language and multimodal › Multimodal LLMs · approach: Chain-of-thought multimodal reasoning · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces ANCHOR, a benchmark for evaluating whether multimodal LLMs ground their audio-visual chain-of-thought reasoning in the actual visual regions and audio events, rather than only checking final answer accuracy.

Problem

MLLMs score well on audio-visual question answering, but correct answers may come from linguistic priors or shortcuts rather than perceptually grounded reasoning; existing benchmarks mostly measure final-answer accuracy and give little insight into the reasoning process.

Approach

A benchmark that evaluates chain-of-thought reasoning for audio-visual questions by checking grounding of reasoning steps to specific visual regions and audio events, not only the final answer. Only the abstract is available, so details of the construction and metrics are unknown.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
remove video (audio-only input) (ablation)Gemini-3-Flash · ANCHOR human-refined setaccuracy (%): 57.7 -> 16.1Hurt
remove video (audio-only input) (ablation)GPT-5.6-Luna · ANCHOR human-refined setaccuracy (%): 52.5 -> 10.7Hurt
remove video (audio-only input) (ablation)Claude-Sonnet-5 · ANCHOR human-refined setaccuracy (%): 52.6 -> 14.2Hurt
add audio evidence (ablation)Gemini-3-Flash · ANCHOR human-refined setaccuracy (%): 52.9 -> 57.7Improved
add bounding boxes (ablation)Gemini-3-Flash · ANCHOR human-refined setaccuracy (%): 50.0 -> 57.7Improved
add bounding boxes (ablation)Claude-Sonnet-5 · ANCHOR human-refined setaccuracy (%): 49.4 -> 52.6Improved
add audio and bounding boxes together (ablation)GPT-5.6-Luna · ANCHOR human-refined setaccuracy (%): 45.0 -> 52.5Improved
compare references: human-refined vs Gemini- or GPT-generated reference (ablation)model ranking · ANCHOR focused subset (100 videos, 446 QA)Pearson r between rankings: r=0.96-1.00, mean 0.99No clear effect
use models with comparable answer score (Gemini-3-Flash vs GPT-5.2)CoT evaluation · ANCHOR full benchmarkHallucination/faithfulness: Answer 3.83 vs 3.77; Halluc. 2.20 vs 2.05Mixed
longer reasoning output (more tokens)MLLM CoT · ANCHOR full benchmarkanswer and faithfulness: Grok-4.1-Fast 644 tokens: Answer 3.39, Halluc. 1.48No clear effect

Experimental setup

Benchmarks: ANCHOR

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy