Are We Evaluating the Edit Locality of LLM Model Editing Properly?

Wei Liu, Haomei Xu, Hongkai Liu, Zhiying Deng, Ruixuan Li, Heng Huang, Yee Whye Teh, Wee Sun LeearXiv 2026 · arXiv

TL;DR

Model editing allows us to surgically update facts within Large Language Models (LLMs), but measuring whether these edits accidentally corrupt unrelated knowledge—a property known as edit locality or specificity—is deeply flawed. This paper reveals that current ground-truth-based evaluation metrics are highly insensitive and biased by language priors. To fix this, the authors introduce a ground-truth-free protocol that directly measures continuous behavioral drift using output logit distributions, enabling far more reliable and fine-grained evaluation.

What Problem Does This Paper Address?

When an LLM holds outdated or incorrect information, retraining the entire model is computationally prohibitive. Instead, researchers use model editing to precisely modify a small subset of parameters to update specific facts.

A successful model edit must balance two goals: efficacy (successfully flipping the target fact) and specificity (leaving unrelated knowledge untouched). For example, if you update the model to know that a scientist now works at MIT instead of Harvard, it shouldn't suddenly forget where other scientists work.

Figure 1. An example of LLM editing: updating the incorrect knowledge with modifying only a small set of parameters.

However, this paper argues that how we evaluate specificity is fundamentally broken. Current protocols rely on comparing the edited model's outputs against hardcoded, human-annotated ground-truth (GT) strings. The authors identify three core issues with this approach:

  1. Open-ended Mismatch: LLMs are open-ended text generators. If a model answers "MIT" instead of the annotated ground truth "Massachusetts Institute of Technology," GT metrics count it as a failure, penalizing benign variations.
  2. Fluency Bias: Many metrics use "teacher-forcing" (evaluating token probabilities given the correct prefix). This causes scores to be dominated by query-independent language priors (e.g., the probability of generating "Institute of Technology" after seeing "Massachusetts") rather than actual factual preservation.
  3. Coarse Discretization: Behavioral deviation is continuous, but GT metrics collapse this into binary true/false judgments, making them blind to moderate but meaningful shifts in model behavior.

Methods

To overcome these limitations, the authors propose a ground-truth-free evaluation protocol. Instead of comparing the edited model to an external text dataset, it directly measures the behavioral deviation between the model before and after the edit.

The protocol introduces two main metrics calculated using the logits of the query's final token:

  • KL-Divergence ($L_{KL}$): Measures the total distributional shift between the pre-edit and post-edit model outputs. This serves as a continuous baseline free from fluency biases.
  • Top-$k$ Support Overlap ($L_{top-k}$): A more human-interpretable metric that calculates the token overlap ratio within the top-$k$ predicted tokens before and after editing. By varying $k$, researchers can smoothly adjust the strictness of the evaluation within a continuous space.

Datasets

The authors evaluated their protocol using two widely adopted benchmarks in model editing literature:

  • Multi-Counterfact (MCF): A counterfactual dataset used to evaluate how edits affect closely related neighborhood concepts.
  • Zero-Shot Relation Extraction (ZsRE): A dataset mapping factual relations, used here to evaluate the preservation of unrelated background knowledge.

Key Insights and Ideas

  • The Pre-Edit Paradox: Shockingly, even before any edits are made, LLMs score terribly on existing specificity metrics (e.g., achieving just 0.5% sample accuracy on ZsRE). This proves that current metrics measure how well a model aligns with a specific dataset's phrasing, rather than measuring the damage caused by an edit.
  • Blindness to Regularization: In "locate-then-edit" methods, a hyperparameter ($\lambda$) controls the strength of the constraint protecting unrelated knowledge. The authors found that as they changed $\lambda$ by orders of magnitude, the actual parameter changes shifted smoothly, but traditional GT metrics barely budged. They are completely saturated and insensitive to real behavioral drift.
  • Random Rankings: Because traditional metrics are noisy and insensitive, they produce highly inconsistent rankings of editing methods across different datasets, making it impossible to reliably state which editing technique preserves background knowledge best.

Key Results

  • Perfect Sensitivity Alignment: The proposed GT-free metrics (KL-divergence and Top-$k$ overlap) exhibited a perfect rank correlation (Kendall’s $\tau = 1.00$) with the actual strength of specificity regularizers. As the regularization weakened, the metrics smoothly and monotonically captured the increasing behavioral drift.
Sensitivity of metrics on the MCF dataset
  • Stable Benchmarking: The authors benchmarked 10 prominent model editing methods (including MEMIT, AlphaEdit, and PMET). While GT-based metrics yielded near-random rank stability across datasets (average Kendall’s $\tau = 0.10$), the proposed GT-free protocol provided highly stable and consistent method rankings (average Kendall’s $\tau = 0.82$).

Limitations and Future Work

The authors note two primary limitations:

  1. Final Token Approximation: The protocol relies on the output logits at the final token position of the query. While standard practice, this does not fully capture long-range dependencies or alternative multi-token generation paths.
  2. Proxy Reference Signals: The sensitivity analysis relies on the strength of the specificity regularizer as a ground-truth reference for behavioral control, which is a strong proxy but may not perfectly map to all forms of real-world model distortion.

Future work could extend this distribution-based approach to multi-token generation sequences to capture broader behavioral changes.

Summary updated

Abstract

Model editing has recently emerged as a popular paradigm for efficiently updating knowledge in LLMs. A central desideratum of updating knowledge is to balance editing efficacy, i.e., the successful injection of target knowledge, and specificity (also known as edit locality), i.e., the preservation of existing non-target knowledge. However, we find that existing specificity evaluation protocols are inadequate for this purpose. We systematically elaborated on the three fundamental issues it faces. Beyond the conceptual issues, we further empirically demonstrate that existing specificity metrics are weakly correlated with the strength of specificity regularizers. We also find that current metrics lack sufficient sensitivity, rendering them ineffective at distinguishing the specificity performance of different methods. Finally, we propose a constructive evaluation protocol. Under this protocol, the conflict between open-ended LLMs and the assumption of determined answers is eliminated, query-independent fluency biases are avoided, and the evaluation strictness can be smoothly adjusted within a near-continuous space. Experiments across various LLMs, datasets, and editing methods show that metrics derived from the proposed protocol are more sensitive to changes in the strength of specificity regularizers and exhibit strong correlation with them, enabling more fine-grained discrimination of different methods' knowledge preservation capabilities.
BibTeX
@misc{liu2026are,
  author = {Wei Liu and Haomei Xu and Hongkai Liu and Zhiying Deng and Ruixuan Li and Heng Huang and Yee Whye Teh and Wee Sun Lee},
  title = {{Are We Evaluating the Edit Locality of LLM Model Editing Properly?}},
  year = {2026},
  eprint = {2601.17343},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2601.17343},
}
Figure