Every Ablation Is a Dose: Counterweights and the Semblance of Self-Repair

Areeb Ahmad, Pratinav Seth, Vinay Kumar SankarapuarXiv 2026 · arXiv

TL;DR

"Self-repair" in large language models—where downstream components seem to magically compensate when an upstream part is deleted—isn't a dynamic, reactive process. Instead, it is a predictable consequence of static "counterweights" already present in the model's weights. By treating ablation as a continuous "dose" rather than a binary switch, the authors show that model components follow a simple affine law, allowing us to predict how a model will "repair" itself just by looking at its static checkpoint.

What Problem Does This Paper Address?

Mechanistic interpretability aims to understand LLMs by identifying "circuits"—subsets of neurons and attention heads responsible for specific tasks. A common tool for this is ablation: deleting a component to see how the model's behavior changes.

However, LLMs exhibit a frustrating phenomenon called self-repair. If you delete a "Name Mover" head in a circuit, other heads often step in to fill the gap. Previous research suggested this process was noisy, inconsistent, and lacked a single underlying mechanism. This makes it incredibly difficult to accurately attribute functions to specific parts of the model, as ablation might underestimate a component's true importance or misattribute its role to "backup" units.

Methods

The authors introduce a new framework that moves beyond binary "on/off" ablations:

  1. The Dose Axis ($\lambda$): They define a continuous coordinate axis for interventions. If $\lambda = 1$, the component is "clean" (normal). If $\lambda = 0$, the component's signal is neutralized. If $\lambda = -1$, the signal is fully inverted (swapped with a counterfactual). Conventional ablations are simply uncalibrated points on this continuous line.
  2. Nested Counterfactual Intervention: To measure the effect, they use a two-step process: first, they "dose" a core component (the "primary intervention"), and then they measure how a downstream unit's contribution changes in that "dosed" world (the "secondary intervention").
  3. Weight-Space Basis: They decompose model writes into fine-grained units, including individual MLP neurons, attention head output (OV) neurons, and singular value decomposition (SVD) directions.
  4. The Affine Law: They propose that the response of a downstream unit $r$ to a dose $\lambda$ on a core $c$ follows a linear relationship: $E_r(\lambda) = \text{own}_r + \gamma_r\lambda$. Here, $\gamma_r$ is the "coupling coefficient." If $\gamma_r < 0$, the unit is a counterweight (opposes the signal); if $\gamma_r > 0$, it is a relay (reinforces the signal).

Datasets

  • Known-Facts Corpus: Used to generate contrastive True/False prompt pairs (e.g., "The capital of France is Paris" vs. "The capital of France is Rome").
  • Indirect Object Identification (IOI): A standard mechanistic interpretability benchmark used to test the framework on the well-studied circuit of GPT-2 Small.
  • Instruction-Tuned Models: Evaluation was performed across four distinct model families: Llama-3-8B, Gemma-2-9B, Qwen2.5-7B, and Mistral-7B.

Key Insights and Ideas

  • Self-Repair is "Standing": The "backup" components aren't recruited on the fly. They are counterweights that are already active in the clean model, constantly pulling against the core signal. When you ablate the core, you simply release that pre-existing tension.
  • Ablation is a Dose: Deleting a neuron isn't a special state; it's just one point on a linear axis of signal strength. This shift in perspective turns a "noisy" phenomenon into a predictable linear one.
  • Legibility in Weights: You can actually predict the magnitude of the coupling ($\gamma_r$) without running any data through the model. By calculating the "wiring alignment"—the cosine similarity between a core's write vector and a downstream unit's read weights—the authors found they could anticipate which components would act as the strongest "repair" units.
  • Universal Law: The affine law held across all four modern model families and even transferred to the much smaller GPT-2 Small, suggesting this is a fundamental property of how Transformers are trained to handle signal redundancy.

Key Results

  • High Predictive Power: The affine law explained the behavior of 68 out of 81 identified downstream directions across the four model families.
  • Strong Correlation: Lines fitted on just three doses (+1, 0, -1) predicted held-out intermediate doses with an out-of-sample $R^2$ between 0.65 and 0.91.
  • Weight-Space Prediction: The static "wiring alignment" statistic correlated strongly with the measured coupling strength (Spearman $\rho$ between 0.55 and 0.82).
  • IOI Circuit Resolution: In GPT-2 Small, 7 out of 10 reachable heads followed the law, and all 7 were confirmed to be counterweights. The strongest coupling was found in the "negative name mover" head (L10.h7), which prior work had already identified as a feedback element.

Limitations and Future Work

  • Task Scope: The study focused on a single-token True/False verdict task. It remains an open question whether this affine law holds for more complex, multi-token generative tasks.
  • Internal Route: While the paper establishes that the coupling exists and is linear, it doesn't fully decompose how the signal travels—whether it's direct re-expression by neurons or re-routing through other downstream components.
  • Gating: The authors acknowledge that "genuine gating" (components that only activate when something is broken) might still exist, though they didn't find evidence for it in these specific circuits.
  • Distributed Components: Some evidence suggests counterweights might respond to signals from multiple distributed components simultaneously, a complexity left for future mapping.

Summary updated

Abstract

Ablate a component of a language model, and other components often appear to adjust and compensate. This phenomenon, termed self-repair, has been observed repeatedly, but its mechanism remains unclear. The most systematic study to date concluded that self-repair is noisy and unlikely to have a single explanation. We argue that it has one: a gain already present before any ablation. Any intervention on a causally important component can be viewed as a point on a coordinate axis $λ$, the signed strength of a counterfactual contrast. Hence, conventional ablation methods are uncalibrated points on this axis. We show that the causal repair response for a fine-grained unit $r$ is governed by an affine law, $E_r(λ)=\mathrm{own}_r+γ_rλ$. The slope $γ_r$ is a fixed coefficient that consistently influences the model, with or without ablation, and its sign determines whether the unit counteracts or reinforces the removed signal. On a factual-verdict task across four models from distinct families (Gemma, Qwen, LLaMA, and Mistral), we identify components including MLP neurons, OV neurons, and singular directions that follow this affine law, 68 of 81 downstream directions in all. Moreover, we can anticipate the magnitude of $γ_r$ from the fixed weights. On the IOI circuit of GPT-2 Small, seven of the ten heads the intervention can reach follow the law, and all seven are counterweights. From this perspective, what may appear as self-repair is a counterweight performing its usual operation when the contrastive signal emerges at the core.
BibTeX
@misc{ahmad2026every,
  author = {Areeb Ahmad and Pratinav Seth and Vinay Kumar Sankarapu},
  title = {{Every Ablation Is a Dose: Counterweights and the Semblance of Self-Repair}},
  year = {2026},
  eprint = {2610.02173},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.02173},
}
Figure