AI Paper Atlas

Research map / Large language models / Language, safety and interpretability

Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense

NeurIPS 2023 · Large language models › Language, safety and interpretability · approach: Zero-shot machine-text detection · 90 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
paraphrase AI text with DIPPER (60L,60O)watermark detector · open-ended generation GPT2-1.5Bdetection accuracy: 100.0 -> 57.2Hurt
paraphrase with DIPPER (60L,60O)DetectGPT · open-ended generation GPT2-1.5Bdetection accuracy: 70.3 -> 4.6Hurt
paraphrase with DIPPER (60L,60O)OpenAI classifier · open-ended generation GPT-3.5detection accuracy: 30.0 -> 15.6Hurt
paraphrase with DIPPERRankGen detector · open-ended generation GPT2-1.5Bdetection accuracy: 13.5 -> 28.5Mixed
use retrieval (BM25) over generation corpus instead of watermark detectionAI text detection · long-form QA GPT2-XL paraphraseddetection accuracy: 55.8 -> 97.8Helped
use BM25 instead of P-SP retriever (ablation)retrieval detector · long-form QA GPT2-XL 9K corpusdetection accuracy: 75.4 -> 95.2Helped
enlarge retrieval corpus from 3K to 9K pooled generations (ablation)BM25 retrieval detector · long-form QA GPT2-XLdetection accuracy: 97.8 -> 95.2Hurt
add 43K ShareGPT responses to retrieval corpus (ablation)BM25 retrieval detector · long-form QA GPT-3.5detection accuracy: 96.2 -> 95.5No clear effect
add left/right context to paraphraser training (ablation)DIPPER · open-ended GPT2-XL generationsGPT-3.5 perplexity preference: 71% preferredHelped
increase paraphrase lexical/order diversityDIPPER · open-ended generationsemantic similarity: 99.2 -> 94.3Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy