Research map / Large language models / Agents, code and math
Discovering Differences in Strategic Behavior between Humans and LLMs
Caroline Wang, Daniel Kasenberg, Kim Stachenfeld, Pablo Samuel Castro
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| multiply IRPS payoffs by 10 when evaluating the Gemini 2.5 Flash SBB program (ablation) | Gemini 2.5 Flash SBB program · IRPS | cross-validated likelihood: 0.491 -> 0.462 | No clear effect |
| use AlphaEvolve programs instead of the CS-EWA behavioral game theory baseline | behavior modeling · IRPS (human and LLM datasets) | normalized cross-validated likelihood: Wilcoxon p < 0.001, Z <= -7.148 | Improved |
| evaluate the human SBB program on LLM datasets instead of the program optimized for that agent | SBB programs · IRPS | cross-validated likelihood: p < 0.001, Z <= -5.73 | Hurt |
Closest papers by meaning
- LLM Strategic Reasoning: Agentic Study through Behavioral Game Theory (NeurIPS 2025 · similarity 0.91)
- Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysis (AAAI 2024 · similarity 0.90)
- When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settings (ICLR 2025 · similarity 0.89)
- Can Large Language Model Agents Simulate Human Trust Behavior? (NeurIPS 2024 · similarity 0.87)
- GTBench: Uncovering the Strategic Reasoning Capabilities of LLMs via Game-Theoretic Evaluations (NeurIPS 2024 · similarity 0.87)
- Position: LLM Social Simulations Are a Promising Research Method (ICML 2025 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
