Research map / Large language models / Alignment and preferences
ALPHA: Action-Based Learning for Pluralistic Human Alignment in Large Language Models
Aanisha Bhattacharyya, Susmit Agrawal, Yaman Kumar Singla, Tarun Ram Menta, Nikitha Sr, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| fine-tune chat model on ALPHA50M behavioral data | Llama-2-7B-chat · OpinionQA-XL | representativeness: 83.61 -> 85.15 | Improved |
| fine-tune chat model on ALPHA50M behavioral data | Llama-2-70B-chat · GSS | steerability: 77.18 -> 81.30 | Improved |
| fine-tune chat model on ALPHA50M behavioral data | Llama-2-13B-chat · OpinionQA-XL | steerability: 81.11 -> 83.54 | Improved |
| fine-tune on ALPHA50M instead of task-specific CultureBank SFT | Llama-2-7B · CultureBank Reddit | entailment score: 85.93 -> 92.39 | Improved |
| fine-tune chat model on ALPHA50M behavioral data | Llama-3-8B-chat · CultureBank Reddit | entailment score: 85.38 -> 85.38 | No clear effect |
| fine-tune on ALPHA50M | Llama-2-13B-chat · post-cutoff Pew surveys Mar-Aug 2023 | opinion alignment: 82.97 -> 84.72 | Improved |
| fine-tune on ALPHA50M | Llama-3-8B-Instruct · post-cutoff Pew surveys Mar-Aug 2023 | opinion alignment: 83.65 -> 84.89 | Improved |
| train on single behavior task (Transsuasion or TAG) instead of all tasks (ablation) | ALPHA-13B · OpinionQA-XL | representativeness: 84.82 and 84.57 vs 86.65 full | Hurt |
| add TAP task for cultural generalization (ablation) | ALPHA-13B · CultureNLI IN | entailment score: 68.39 (best single task) | Improved |
| vary which behavior task is used (ablation) | ALPHA-13B · GSS | steerability | No clear effect |
Closest papers by meaning
- Understanding the Learning Dynamics of Alignment with Human Feedback (ICML 2024 · similarity 0.91)
- Position: A Roadmap to Pluralistic Alignment (ICML 2024 · similarity 0.90)
- Group Preference Optimization: Few-Shot Alignment of Large Language Models (ICLR 2024 · similarity 0.89)
- The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models (NeurIPS 2024 · similarity 0.88)
- Training-Free Cultural Alignment of Large Language Models via Persona Disagreement (NeurIPS 2026 · similarity 0.88)
- Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codes (ICML 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
