AI Paper Atlas

Research map / Adversarial robustness and security / Attacks on text and graphs

Punctuation-level Attack: Single-shot and Single Punctuation Can Fool Text Models

Wenqiang Wang, Chongyang Du, Tao Wang, Kaihao Zhang, Wenhan Luo, Lin Ma, Wei Liu, Xiaochun Cao

NeurIPS 2023 · Adversarial robustness and security › Attacks on text and graphs · approach: Adversarial prompts for language models · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use Insertion instead of Deletion attack mode (ablation)punctuation-level attack · CoLA, ELECTRAfool rate (Top-1): 5.18% -> 67.40%Improved
use Insertion traversal search instead of single-shot Top-1 (ablation)punctuation insertion attack · CoLA, ELECTRAfool rate: 67.40% -> 90.80%Improved
increase Top-k candidates from Top-1 to Top-3 and Top-5 (ablation)punctuation insertion attack · CoLA, ELECTRAfool rate: 67.40% -> 73.06% -> 73.83%Improved
increase average search space (CoLA 362.62 to Wanli 1161.12) (ablation)single-shot Insertion attack · Wanli, RoBERTafool rate (Top-1): 67.40% -> 8.44%Hurt
use Displacement instead of Insertion for single shot (ablation)punctuation attack · CoLA, XLMRfool rate (Top-1): 28.76% -> 43.05%Improved
use Replacement instead of Insertion for single shot (ablation)punctuation attack · Wanli, RoBERTafool rate (Top-1): 8.44% -> 8.48%No clear effect
apply Insertion attack Top-1 (ablation)Sentence-BERT · STS-BPearson correlation: 0.7990 -> 0.7874Hurt
apply Insertion attack traversal (ablation)Sentence-BERT · STS-BPearson correlation: 0.7990 -> 0.6992Hurt
apply Insertion attack Top-1 (ablation)Distilbert · STS-BSpearman correlation: 0.7257 -> 0.7035Hurt
apply Insertion attack Top-1 (ablation)summarization model · GigawordROUGE-1: 11.69 -> 10.91Hurt
apply Insertion attack traversal (ablation)summarization model · GigawordROUGE-1: 11.69 -> 5.22Hurt
insert a punctuation into prompt (Top-1) (ablation)Stable Diffusion V2 · text-to-imageCLIP score: 0.3278 -> 0.3176Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy