AI Paper Atlas

Research map / Adversarial robustness and security / Attacks on text and graphs

Pay Less Attention to Function Words for Free Robustness of Vision-Language Models

Qiwei Tian, Chenhao Lin, Zhengyu Zhao, Chao Shen

ICLR 2026 · Adversarial robustness and security › Attacks on text and graphs · approach: Vision-language model robustness · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add FDA (function-word de-attention) to fusion layersBLIP · Flickr30k retrieval targeted attacksavg ASR drop: +51.60% (eps 2/255), +56.36% (eps 4/255)Improved
add FDAALBEF · RefCOCO+ groundingavg ASR drop: 93.16/91.50 vs TeCoA 21.21/21.63Improved
add FDA vs adversarial fine-tuning (TeCoA, FARE) on clean performanceALBEF · Flickr30k T2IRclean R@1: 91.20 -> 95.60Improved
add FDA vs no defense on clean accuracyALBEF · MSCOCO T2IRclean R@1: 77.60 -> 77.70No clear effect
add FDA vs TeCoA on stronger eps 4/255 attacksTeCoA/FARE · Flickr30k retrieval, ALBEFavg ASR drop: -2.15 -> 14.69Improved
add FDA to TeCoA and FAREALBEF · untargeted attacks retrievalavg ASR drop: 0.47 -> 1.31 (TeCoA), 13.09 -> 13.46 (FARE)Improved
apply FDA in fusion encoder only rather than text encoder only (ablation)FDA · Flickr30k retrieval, ALBEFavg ASR drop: -2.54 -> 18.48Improved
apply FDA in both text and fusion encoders instead of fusion only (ablation)FDA · Flickr30k retrieval, ALBEFavg ASR drop / clean: 18.48 -> 15.61Hurt
use shortlisted 91-word dictionary instead of full 208-word dictionary (ablation)FDA · Flickr30k retrieval, ALBEFavg ASR drop: 4.22 -> 6.45Improved
apply FDA in shallow layers (L0-1) instead of all layers (ablation)FDA · Flickr30k retrieval, BLIPavg ASR drop: 26.46 -> 53.98Improved
use FDA instead of directly masking function words (ablation)ALBEF · Flickr30k retrievalavg ASR drop: 1.56 -> 23.07Improved
de-attend determiners or adjectives instead of all function words (ablation)FDA · Flickr30k retrieval, ALBEFavg ASR drop: 23.07 -> 9.28 (DDA), 15.10 (ADA)Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy