Vision Sparse Autoencoder L0
That expression formalizes the prose definition. The PDF text used here does not display this equation.
That expression formalizes the prose definition. The PDF text used here does not display this equation.
How the Activation Controllability Benchmark paper works: a fixed copy task, a 0.85 similarity keep-rule, and residual-stream concept projections.
Gao et al.'s logit-diff ablation score measures how sparse an SAE latent's effect on output logits is. It is not a rule for admitting circuit components.
Gao et al. (2024) cite the BERT interpretability illusion as a gloss: random activating examples can make an overly broad feature explanation look right.
In arXiv:2412.09565v2 (Bailey et al., 8 Feb 2025), an activation is obfuscated against a named latent-space monitor D, not obfuscated in the abstract.
An extracted subgraph is not yet a causal circuit. Read it as causal only after the paper’s own intervention controls are fixed, and do not fill parameters…
These are three different early-token procedures, not three placements of one prefix. In Ding, Li, and Zhang, ETA ( arXiv:2410.06625v2 , ICLR 2025; version…
In arXiv:2602.13483v2, ACC++ forms one rank-1 candidate for each pair (upstream component, singular direction of the head’s QK matrix Ω), builds the…
In Huang et al., arXiv:2608.11295v1, the post- </think> probe token, the 64–160-example backdoor and decontamination corpus, and the top-10 layerwise…
GPT-4 writes natural-language explanations of 307,200 GPT-2 XL MLP neurons across 48 layers, then scores them by simulating activations on held-out text.