Research map / Multi-agent systems and games / Human-AI and goal-conditioned
Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabi
Ho Chit Siu, Jaime Daniel Pena, Edenna Chen, Yutai Zhou, Victor Lopez, Kyle Palko, Kimberlee Chestnut Chang, Ross Emerson Allen
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use learning-based Other-Play teammate instead of rule-based SmartBot | human-AI Hanabi team · Hanabi game score, 29 participants | game score: t(158)=0.374, p=0.709 | No clear effect |
| use Other-Play instead of SmartBot teammate | human-AI Hanabi team · post-game teamwork (G5) | Likert rating: t=2.578, p=0.011 | Hurt |
| use Other-Play instead of SmartBot teammate | human-AI Hanabi team · post-game comfort (G9) | Likert rating: t=3.302, p=0.001 | Hurt |
| use Other-Play instead of SmartBot teammate | human-AI Hanabi team · post-experiment preference, trust, reliability (E1-E7) | Likert preference | Hurt |
| use Other-Play instead of SmartBot teammate | human-AI Hanabi team · post-experiment mental workload (E8) | Likert preference | No clear effect |
| higher self-rated Hanabi experience of participant when paired with Other-Play | human-AI Hanabi team · post-game ratings (G3, G5, G7, G8, G9) | Likert rating: t(85)=5.068 to 5.855 | Hurt |
Closest papers by meaning
- Ad-Hoc Human-AI Coordination Challenge (ICML 2025 · similarity 0.89)
- Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain (ICLR 2024 · similarity 0.88)
- Sparks of Cooperative Reasoning: LLMs as Strategic Hanabi Agents (ICML 2026 · similarity 0.87)
- An Evolutionary Perspective on AI Alignment (Student Abstract) (AAAI 2025 · similarity 0.86)
- Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems (NeurIPS 2024 · similarity 0.86)
- Designing Skill-Compatible AI: Methodologies and Frameworks in Chess (ICLR 2024 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
