AI Paper Atlas

Research map / Large language models / Language, safety and interpretability

A geometric relation of the error introduced by sampling a language model's output distribution to its internal state

Albert F. Modenbach

ICML 2026 · Large language models › Language, safety and interpretability · approach: Pruning and circuits in LLMs · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
apply the derived holonomy operator instead of a norm-matched random SO(n) matrix (ablation)q = Hy - y PCA on Qwen2.5-32B-Instruct · Chess branch pointsvariance in top 2 PCs: 34.8% -> 53.9%Improved
apply the holonomy operator instead of a simple rotation of z_t onto v1 or v2 (ablation)q PCA on Qwen2.5-32B-Instruct · Chess branch pointsvariance in top 2 PCs: 31.4% for simple rotation vs 53.9%Improved
use coupling of Hy rather than q = Hy - y (curvature) (ablation)holonomy coupling analysis · Chess branch pointssemantic coupling to world vectorsHurt
separate active and bulk probes by selecting the maximum coupling probe instead of averaging over all probes (ablation)coupling analysis · Chess branch pointsseparability of active vs bulk probe couplingsImproved
consider delta q across greedy/branch boundary, coupling by chess piece typeQwen2.5-32B-Instruct · Chess branch pointsSpearman rho of coupling vs piece value: rho = 0.90, p = 0.037Improved
replace Qwen with held-out Mistral modelholonomy analysis · Chess branch pointspiece-importance coupling and PCA structure: rho = -0.90, p = 0.037; flow direction reversed vs QwenMixed
use poorer probes (Mistral) in place of Qwen probesholonomy analysis · Chess branch pointsPCA axis magnitudeHurt
compare delta y (state difference) with delta q (curvature) coupling to world vectorsQwen2.5-32B-Instruct · Chess branch pointscoupling to probesImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy