AI Paper Atlas

Research map / Large language models / AI and society

Too Sure for Our Own Good: A User Study on AI Confidence and Human Reliance

Caterina Fregosi, Lucia Vicente, Andrea Campagner, Federico Cabitza

AAAI 2026 · Large language models › AI and society · approach: Human-centered trust and agency · 7 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use well-calibrated instead of miscalibrated AI confidenceAI decision support confidence scores · Logic puzzle user study (n=184)mean accuracy improvement: 0.02 -> 0.20Improved
use miscalibrated confidence (vs no accuracy gain baseline)AI decision support confidence scores · Logic puzzle user study (n=184)mean accuracy improvement: +0.02, 95% CI [-0.00, 0.04]No clear effect
use well-calibrated instead of miscalibrated confidenceAI decision support confidence scores · Logic puzzle user study (n=184)appropriate reliance: 0.25 -> 0.47Improved
show high instead of low AI confidenceAI decision support confidence scores · Logic puzzle user study (n=184)appropriate reliance: 0.27 -> 0.49Improved
miscalibrate AI confidenceAI decision support confidence scores · Logic puzzle user study (n=184)automation bias (odds ratio): 0.14 -> 0.46Hurt
miscalibrate AI confidenceAI decision support confidence scores · Logic puzzle user study (n=184)conservatism bias (odds ratio): 0.54 -> 6.29Hurt
show high instead of intermediate confidenceAI decision support confidence scores · Logic puzzle user study (n=184)automation bias (odds ratio): 0.07 -> 0.46Hurt
show low instead of high confidenceAI decision support confidence scores · Logic puzzle user study (n=184)conservatism bias (odds ratio): 0.53 -> 5.96Hurt
use calibrated instead of miscalibrated confidenceAI decision support confidence scores · Logic puzzle user study (n=184)average perceived utility: 2.09 -> 2.21Improved
show high instead of low confidenceAI decision support confidence scores · Logic puzzle user study (n=184)average perceived utility: 1.87 -> 2.48Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy