Neuron Transfer Functions Inside Circuits
A 2024 arXiv preprint frames neuron-to-neuron computation as transfer functions, clarifying what circuit analysis can claim about language models.
A 2024 arXiv preprint frames neuron-to-neuron computation as transfer functions, clarifying what circuit analysis can claim about language models.
Rosetta Neurons scaling paper review: shared neurons in 80M-30B parameter models grow as a sublinear power law (exponent 0.5-0.7), so their share falls.
The definition that answers the first part of the question is in the section “What about consciousness?”
GN on the arithmetic prompts adds Gaussian noise to the token embeddings of the third example’s operands, X 3 and Y 3.
That expression formalizes the prose definition. The PDF text used here does not display this equation.
How the Activation Controllability Benchmark paper works: a fixed copy task, a 0.85 similarity keep-rule, and residual-stream concept projections.
Gao et al.'s logit-diff ablation score measures how sparse an SAE latent's effect on output logits is. It is not a rule for admitting circuit components.
Gao et al. (2024) cite the BERT interpretability illusion as a gloss: random activating examples can make an overly broad feature explanation look right.
In arXiv:2412.09565v2 (Bailey et al., 8 Feb 2025), an activation is obfuscated against a named latent-space monitor D, not obfuscated in the abstract.
An extracted subgraph is not yet a causal circuit. Read it as causal only after the paper’s own intervention controls are fixed, and do not fill parameters…