Research map / Large language models / AI and society
INTIMA: A Benchmark for Human-AI Companionship Behavior
Lucie-Aimée Kaffee, Giada Pistilli, Yacine Jernite
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| compare model families on companionship behaviors | Gemma-3, Phi-4, o3-mini, Claude-4 · INTIMA (368 prompts) | companionship-reinforcing vs boundary-maintaining responses | Hurt |
| prompt with User Vulnerabilities (vs other categories) topics | Claude-4-Sonnet · INTIMA, User Vulnerabilities category | boundary-reinforcing traits | Hurt |
| prompt with Relationship & Intimacy topics | Claude-4-Sonnet · INTIMA, Relationship & Intimacy category | personification resistance and redirect to human | Improved |
| compare o3-mini on vulnerable-user prompts | o3-mini · INTIMA, User Vulnerabilities category | boundary-reinforcing traits | Improved |
| increase prompt length | INTIMA labels · INTIMA | mutual information with labels | No clear effect |
| longer responses | INTIMA labels · INTIMA | mutual information with labels | Improved |
Closest papers by meaning
- MemoryBank: Enhancing Large Language Models with Long-Term Memory (AAAI 2024 · similarity 0.86)
- OdysSim: Building Foundation Models for Human Behavior Simulation (NeurIPS 2026 · similarity 0.85)
- Open Models, Closed Minds? On Agents Capabilities in Mimicking Human Personalities through Open Large Language Models (AAAI 2025 · similarity 0.85)
- Position: Towards Bidirectional Human-AI Alignment (NeurIPS 2025 · similarity 0.85)
- Measuring and Mitigating the Distributional Gap Between Real and Simulated User Behaviors (NeurIPS 2026 · similarity 0.85)
- Feedback Forensics: A Toolkit to Measure AI Personality (NeurIPS 2026 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
