AI Paper Atlas

Research map / Large language models / Language, safety and interpretability

Do Language Models Track Entities Across State Changes?

Zilu Tang, Qiao Zhao, Gabriel Franco, Derry Tanti Wijaya, Aaron Mueller, Sebastian Schuster, Najoung Kim

ICML 2026 · Large language models › Language, safety and interpretability · approach: Reasoning mechanisms and failure modes · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
global (all objects) linear probe on last-token residual streamCodeLlama-13B · box entity trackingglobal probe non-trivial accuracy: global < 0.3 vs local near 0.9No clear effect
probe for prior states across layersCodeLlama-13B · box entity tracking, 1-3 local operationsprobe accuracy by layerNo clear effect
patch heads or subspaces from description circuit to PUT circuit (ablation)CodeLlama-13B · PUT vs DESCRIPTION circuitspatching recoveryImproved
nullify remove tag at box ID token (ablation)CodeLlama-13B · REMOVE interventiontarget object successNo clear effect
nullify remove tag at object token (ablation)CodeLlama-13B · REMOVE intervention, earlier layerstarget object successImproved
nullify remove tag at object token in failure cases (ablation)CodeLlama-13B No-op Remove · No-op Removeintervention success: 0.66Improved
nullify remove tag at object token in failure cases (ablation)CodeLlama-13B re-introduction · Re-introducing removed objectintervention success: 0.24Mixed
scale model from 13B to 70B (ablation)entity tracking diagnostics · Re-introducing removed objectdegeneration rate: 0.62 -> 0.01Improved
add more operations in context (ablation)CodeLlama-13B · box ID remove tag probeprobe accuracyHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy