Latent Correctness Directions Emerge from Residual Activations Without Probes
Latent correctness directions appear in residual activations of language models when using Jacobian lenses and sparse autoencoders instead of probes.
Latent correctness directions appear in residual activations of language models when using Jacobian lenses and sparse autoencoders instead of probes.
In brief J-space detects model misalignment by examining a compact internal workspace in large language models that handles deliberate reasoning, using the…
In brief Mid-layer activations in language models are projected by the Jacobian lens through transport matrices derived from averaged input-output…
In brief Anthropic's interpretability research employs dictionary learning with sparse autoencoders to extract monosemantic features from the internal…
at a Glance Transformer Attention wins for AI researchers and engineers building systems at global scale because of its parallel processing and O(n²)…
The jacobian lens is a gradient-based method that identifies j space in Claude's internal representations, a sparse subspace accounting for less than 10%…
The emergent workspace in LLMs 2026 is a limited-capacity subspace inside the residual stream of large language models that holds roughly 25 verbalizable…
The Jacobian lens uses input-output Jacobians to find j space, a low-dimensional workspace of verbalizable concepts. How to compute it and what it reveals.
How j-space works as a limited-capacity workspace in language models, and what circuit tracing and attribution graphs show about reportable reasoning.
J-space is a small internal workspace in large language models, found with the Jacobian lens. What it is, how it was found, and what it means for AI safety.