Unembedding Proximity Pulls Residual Effects Into Late Layers
Late residual writes sit immediately upstream of the unembedding and bias decoder-aligned effects toward the last blocks.
Why Extra Residual Features Fail to Add Workspace Slots
Published widths from 768 to 12288 bound how many residual directions stay independent. Extra features interfere instead of adding workspace slots.
Five Tests Separate Steerable SAE Features From Reportable Runtime Monitors
Apply five tests so residual-stream directions become human-labelable, probe-readable and verbally usable. A clamp alone cannot monitor a live model.
Score Hidden Objectives Before Compliant Tokens Appear
Score hidden objectives before a compliant token emits. J-Lens reads residual Jacobians as a complementary readout, not an alignment proof.
Confirm Layer Selection With Patching Before You Trust Attention Maps
Attention weights leave the real selector hidden. State a claim, then patch activations to show which residual hypotheses a layer amplifies or suppresses.
What the J Lens Protocol Isolates That a Logit Lens Cannot
Isolate causal paths and confirm necessity on residual streams with the J Lens joint lens and first-order Jacobian stack.
Tracing Causal Paths in Claude’s Addition and Safety Circuits
Researchers map how features causally influence Claude outputs by reconstructing prompt specific graphs with sparse autoencoders and cross layer…
Sparse Autoencoders Use L1 Penalties to Isolate Distinct Model Features
Sparse autoencoders use L1 penalties on residual activations to generate sparse mostly zero latents that correspond to candidate features in language…
Safety Teams Decode AI Models Using Mechanistic Interpretability in 2026
Safety teams use mechanistic interpretability to reveal AI behaviors missed by tests, making safety operational in 2026.
Latent Correctness Directions Emerge from Residual Activations Without Probes
Latent correctness directions appear in residual activations of language models when using Jacobian lenses and sparse autoencoders instead of probes.