AI Paper Atlas

Research map / Large language models / AI and society

A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors

Yuxuan Lei, Jianxun Lian, Defu Lian, Jincenzi Wu, Tianfu Wang, Xing Xie

ICML 2026 · Large language models › AI and society · approach: Critiques of LLM claims and judging

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
scale Qwen2.5 from 3B to 72BQwen2.5 simulator · Amazon Movies&TVconsistency: 0.2100 -> 0.8160Improved
scale Llama-3.1 from 8B to 405BLlama-3.1 simulator · Amazon Movies&TVaverage score: 0.3282 -> 0.4560Improved
use GPT-4o instead of Llama-3.1-405Bbehavior simulator · Amazon Movies&TVaverage score: 0.4560 -> 0.5052Improved
use real user behavior instead of GPT-4obehavior simulator · Stackexchange Worldbuildingaverage score: 0.6247 -> 0.7504Improved
use real user behavior instead of GPT-4obehavior simulator · Amazon Movies&TVdistinguishability: 0.3800 -> 0.4820Improved
use E5-large instead of E5-base as user encoder (ablation)evaluation framework · Stackexchange Worldbuilding (user encoder ablation)consistency of Qwen2.5-72B: 0.7610 -> 0.7695Improved
use Bge-base instead of E5-base as user encoder (ablation)evaluation framework · Stackexchange Worldbuilding (user encoder ablation)consistency of Qwen2.5-72B: 0.7610 -> 0.7570Hurt
use 2-layer MLP instead of 1-layer MLP classifier head (ablation)evaluation framework · Amazon Movies&TV (classifier head ablation)consistency of GPT-4o: 0.4000 -> 0.8800Improved
use 2-layer MLP instead of joint user encoder training (ablation)evaluation framework · Amazon Movies&TV (classifier head ablation)consistency of GPT-4o: 0.6600 -> 0.8800Improved
use 2-layer MLP instead of XGBoost on fixed embeddings (ablation)evaluation framework · Amazon Movies&TV (classifier head ablation)consistency of Qwen2.5-72B: 0.6780 -> 0.8160Improved
use 3-layer MLP instead of 2-layer MLP (ablation)evaluation framework · Amazon Movies&TV (classifier head ablation)consistency of Qwen2.5-72B: 0.8160 -> 0.8340No clear effect
increase simulated sequence length bucketLlama-3.1 simulators · Amazon Movies&TVpredictabilityHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy