atlas

Research map / Large language models / AI and society

A Mathematical Framework for AI-Human Integration in Work

ICML 2025 · Large language models › AI and society · approach: Social-science view of AI evaluation

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes a mathematical framework modeling jobs, workers, and worker-job fit with decision-level and action-level subskills, deriving phase transitions and merging/productivity-compression results, and illustrating with O*NET and BIG-bench Lite data.

Problem

Existing evaluations conflate reasoning and action skills and lack a formal way to assess how GenAI tools and human workers complement each other at the job level, including when job success changes sharply with ability.

Approach

Decompose each skill into decision-level and action-level subskills with ability profiles under noise; define job success probability via aggregated subskill error rates; prove phase-transition bounds via McDiarmid concentration and show merging workers with complementary subskills yields gains, explaining productivity compression.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Increase decision-level ability a₁ from 0.492 to 0.513Proposed framework · Synthetic linear-profile job, σ = 0.1job success probability: 0.2 to 0.8Helped
Reduce noise σProposed framework · Synthetic linear-profile jobssharpness of job success probability transitionHelped
Increase decision-level ability a from 0.07 to 0.34Proposed framework · Synthetic dependent-subskill job, p = 0job success probability: 0.2 to 0.8Helped
Increase decision-level ability aProposed framework · Synthetic dependent-subskill job, p = 0.4ability increase for job success probability change: 0.44Hurt
Combine W₁ decision-level ability with W₂ action-level abilityComplementary workers W₁ and W₂ · Synthetic complementary-worker jobjob success probability: P₁₂ = 1 while P₁ = P₂ = 0.4; gain of 0.6Helped
Increase dependency between subskill errors pProposed framework · Synthetic dependent-subskill jobjob success probabilityMixed
Assign each subskill to the worker with higher expected abilityWorkers W₁ and W₂ · Computer Programmer example, a ≤ 0.22 and c ∈ [0.78, 0.82]job success probability: P_merge = 1 while P₁, P₂ ≤ 0.6; gain of at least 0.4Helped
Use strongly correlated subskill noise instead of independent noiseProposed framework · Synthetic jobsensitivity of job success probability to abilityHurt

Surprising findings

Limitations

Experimental setup

Datasets: O*NET BIG-bench Lite

Benchmarks: BIG-bench Lite O*NET

Metrics: job success probability phase transition width merging gain productivity compression

Baselines: PaLM

Builds on: McDiarmid's inequality O*NET BIG-bench Lite

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy