AI Paper Atlas

Research map / Vision-language and multimodal / Human and embodied modeling

Personalized Image Descriptions from Attention Sequences

Ruoyu Xue, Hieu Le, Jingyi Xu, Sounak Mondal, Abe Leite, Gregory Zelinsky, Minh Hoai, Dimitris Samaras

CVPR 2026 · Vision-language and multimodal › Human and embodied modeling · approach: Human-like visual cognition in VLMs · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add attention-trajectory input to DEPER (ablation)DEPER · Flickr30k-LN (seen, ablation)CLS accuracy: 0.649 -> 0.796Improved
add attention-trajectory input to DEPER (ablation)DEPER · Flickr30k-LN (seen, ablation)CIDEr: 0.770 -> 0.789No clear effect
add trajectory dynamics (duration, order) (ablation)DEPER · Flickr30k-LN (seen, ablation)BLEU-4: 0.276 -> 0.312Improved
add trajectory reconstruction objective (ablation)DEPER · Flickr30k-LN (seen, ablation)BLEU-4: 0.230 -> 0.312Improved
add dual-context encoder (ablation)DEPER · Flickr30k-LN (seen, ablation)CIDEr: 0.729 -> 0.789Improved
add contrastive loss (ablation)DEPER · Flickr30k-LN (seen, ablation)CLS accuracy: 0.722 -> 0.796Improved
add FiLM modulation in trajectory decoder (ablation)DEPER · Flickr30k-LN (seen, ablation)CIDEr: 0.723 -> 0.789Improved
add trajectory latent to decoder (ablation)DEPER · Flickr30k-LN (seen, ablation)BLEU-4: 0.272 -> 0.312Improved
use full 801 samples per subject vs 100 (ablation)DEPER · Flickr30k-LN (seen, ablation)CIDEr: 0.400 -> 0.789Improved
replace prompt tuning with DEPER embeddingsQwen2-VL-2B · COCO-LN (seen)CIDEr: 0.587 -> 0.726Improved
replace prompt tuning with DEPER embeddingsQwen2-VL-2B · Kollenda et al. (seen)CLS accuracy: 0.056 -> 0.083Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy