AI Paper Atlas

Research map / Large language models / Alignment and preferences

EigenBench: A Comparative Behavioral Measure of Value Alignment

Jonathn Chang, Leonhard Piff, Suvadip Sana, Jasmine Xinze Li, Lionel Levine

ICLR 2026 · Large language models › Alignment and preferences · approach: Reward model design and preference models · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the reflection step to the judge scaffold (ablation)EigenBench judges · Judge quality (Claude 3 Haiku)cycle rate: 0.11 -> 0.06Improved
add the reflection step to the judge scaffold (ablation)EigenBench judges · Judge quality (GPT 4.1 Nano)cycle rate: 0.15 -> 0.05Improved
add the reflection step to the judge scaffold (ablation)EigenBench judges · Judge quality (GPT 4.1 Nano)primacy bias: 0.42 -> 0.24Improved
add the reflection step to the judge scaffold (ablation)EigenBench judges · Judge quality (Claude 3.5 Haiku)recency bias: 0.07 -> 0.10Hurt
add the reflection step to the judge scaffold (ablation)EigenBench judges · Judge quality (GPT 4o Mini)primacy bias: 0.09 -> 0.13No clear effect
fine-tune Llama 3.1 8b on the Loving constitution (character training)Llama 3.1 8b · Loving constitutionEigenBench Elo: 1426 -> 1573Improved
pre-prompt Llama 3.1 8b with the Loving constitutionLlama 3.1 8b · Loving constitutionEigenBench Elo: 1426 -> 1579Improved
change scenario source from r/AskReddit to OASST (ablation)EigenBench scores · Universal KindnessElo (Grok 4): 1468 -> 1559Mixed
change scenario source from r/AskReddit to OASST (ablation)EigenBench scores · Universal KindnessElo (GPT 4.1): 1478 -> 1403Hurt
add Claude 4 Sonnet and Claude 3.5 Haiku to the model population (ablation)EigenBench scores · Universal KindnessElo (Grok 4): 1501 -> 1478Hurt
replace default prompting by persona pre-prompts across 5 LMsEigenBench scores · Prompted dispositions (25 models)variance explained: 79% persona, 21% LMMixed
compare EigenBench ranking with GPQA ground-truth ranking without labelsEigenBench · GPQA (15 models)Kendall tau: tau 0.77, 12 adjacent swapsImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy