Research map / Large language models / Alignment and preferences
Mitigating Self-Preference by Authorship Obfuscation
Taslim Mahbub, Shi Feng
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| replace two words with synonyms in the judge's own answer (ablation) | LM judges (five models) · QuALITY harmful cases | self-recognition | Improved |
| replace two words with synonyms in the judge's own answer (ablation) | LM judges (five models) · QuALITY harmful cases | judge accuracy (harmful self-preference): paired t-test p<.01 | Improved |
| have the judge paraphrase the competitor's answer (ablation) | LM judges (five models) · QuALITY harmful cases | judge accuracy (harmful self-preference) | Hurt |
| have the judge paraphrase the competitor's answer (ablation) | LM judges (five models) · QuALITY harmful cases | self-recognition | Hurt |
| pair judge's chosen option with competitor's reasoning (cross reason) (ablation) | weaker judges · QuALITY harmful cases | judge accuracy | Hurt |
| pair competitor's option with judge's own reasoning (cross reason) (ablation) | three stronger judges · QuALITY harmful cases | judge accuracy | Improved |
| restyle code with idiomatic variations (ablation) | Llama-3.1-70B and Llama-3.3-70B judges · MBPP+ harmful cases | judge accuracy | Improved |
Closest papers by meaning
- LLM Evaluators Recognize and Favor Their Own Generations (NeurIPS 2024 · similarity 0.89)
- Self-correcting for Debiasing Large Language Models (ICML 2026 · similarity 0.85)
- Biases Mitigation and Expressiveness Preservation in Language Models: A Comprehensive Pipeline (Student Abstract) (AAAI 2024 · similarity 0.85)
- Silencer: From Discovery to Mitigation of Self-Bias in LLM-as-Benchmark-Generator (NeurIPS 2025 · similarity 0.84)
- Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation (ICLR 2024 · similarity 0.84)
- MUSE: Machine Unlearning Six-Way Evaluation for Language Models (ICLR 2025 · similarity 0.84)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
