Auditing Machine Unlearning: A Systematic Research on Whether Models Truly Forget

Dayong Ye, Tianqing Zhu, Ruiding Huang, Xinbo Fu, Jiayang Li, Bo Liu, Huan Huo, Wanlei ZhouarXiv 2026 · arXiv

TL;DR

This paper introduces the first practical, black-box auditing framework to verify whether machine unlearning algorithms have truly erased specific data from a model. Inspired by the cryptographic concept of "proof of ignorance," the framework eliminates the need for expensive retraining-from-scratch baselines or massive shadow models, achieving high accuracy with minimal computational overhead.

What Problem Does This Paper Address?

With regulations like GDPR enforcing the "right to be forgotten," machine unlearning has become essential for removing the influence of specific user data from trained models. However, verifying whether a model has actually forgotten that data remains a major challenge.

Existing auditing methods suffer from severe practicality issues:

  1. Parametric and Behavioral Auditing require comparing the unlearned model against a reference model retrained completely from scratch. This is computationally prohibitive and defeats the purpose of fast, approximate unlearning.
  2. Membership Inference Attacks (MIAs) require training dozens of "shadow models" to guess if a sample was in the training set, which is expensive and often yields low accuracy.
  3. Backdoor-based methods require injecting triggers before the model is initially trained, which is unrealistic for post-hoc user deletion requests.

This paper bridges the gap by creating a self-contained, efficient, and black-box auditing framework that requires no intrusive intervention in the original training process.

Methods

The framework is grounded in the Proof of Ignorance. The core intuition is: If a verification model—which is guaranteed to have never seen the deleted data—can be easily transformed to behave identically to the unlearned model, then the unlearned model must also be ignorant of that data.

[Unlearned Model (Mu)] <------- Compare Outputs -------> [Verification Model (Mv)]
                                                                ^
                                                                | (Train on ~15% 
                                                                |  of remaining data)
                                                                |
                                                      [Remaining Data (Dr)]

The auditing protocol follows a three-step pipeline after a lightweight Preliminary Check (which immediately rejects models that still show suspiciously high accuracy on the deleted data):

  1. Verification Model Construction: The auditor randomly samples a small, representative subset ($D_v$, averaging just 15%) of the remaining data ($D_r$). The prover trains a clean verification model ($M_v$) on this subset. Because $D_v$ is entirely disjoint from the unlearning data ($D_u$), $M_v$ is guaranteed to be "ignorant" of it.
  2. Output Comparison: The auditor queries both the unlearned model ($M_u$) and $M_v$ using the deleted data ($D_u$) and calculates a model agreement metric ($\nu$). If the agreement exceeds a dynamically calculated threshold ($\zeta$), the audit passes.
  3. Verification Model Refinement: If agreement is low, the prover gets one opportunity to refine $M_v$ (by adding/removing data or aligning decision boundaries based on accuracy discrepancies). If they still cannot align the models within polynomial time, the unlearned model is rejected.

Datasets

The authors evaluated their framework across multiple modalities:

  • Image Datasets: CIFAR10, SVHN, and SkinCancer (for binary/multi-class classification).
  • Text Datasets: BBCNews, AGNews, and IMDB.
  • LLM Evaluation: Fine-tuned OPT-2.7B using PKU-SafeRLHF as the unlearning dataset ($D_u$) and TruthfulQA as the remaining dataset ($D_r$).

Key Insights and Ideas

  • Catastrophic Forgetting is a Feature: Fine-tuning-based unlearning methods (like standard Fine-Tuning or Gradient Ascent + Fine-Tuning) are highly effective. Continued training on the remaining data naturally overwrites and erases the old decision boundaries of the deleted data.
  • Performance Degradation $\neq$ Forgetting: De-optimization methods (like standard Gradient Ascent or Relabeling without subsequent fine-tuning) fail audits. They simply corrupt the model's overall utility or tank accuracy on the target set, but the underlying data distribution's influence remains intact.
  • Theoretical Certificates Can Fail in Practice: Fisher/Hessian-based methods—even those with formal $(\epsilon, \delta)$-unlearning certifications—failed the behavioral audits. Proximity in parameter space to a retrained model does not guarantee identical behavioral forgetting on the specific deleted samples.
  • Robust Against Fakers: The framework successfully detects adversarial provers attempting "Fake Retraining" (unlearning gradient-similar data instead of the true target data) or "Forging-based Retraining."

Key Results

  • High Auditing Accuracy: Validation experiments showed exceptionally low False Positive Rates (FPR) and False Negative Rates (FNR), both staying below 0.02 across all six standard datasets.
  • Clear Categorization of Unlearning Efficacy:
  • Successful: Retrain, Adversarial Retrain, Fine-tuning, Relabel+FT, and GA+FT all passed the audit, showing high agreement with the clean verification models.
  • Failed: Relabeling and Gradient Ascent alone failed due to severe model degradation. Fisher, Hessian, and Certified Hessian methods failed because they behaved almost identically to the pre-unlearned model.
  • LLM Generalizability: When auditing OPT-2.7B, the framework successfully distinguished between true unlearning (Retrain, GA+FT) and failed attempts (GA alone, or complex combinations like GA+Relabel+FT which suffer from conflicting optimization objectives).

Limitations and Future Work

The authors note that their current framework evaluates static unlearning requests. They point out that a promising and necessary direction for future work is extending this framework to handle streaming unlearning, where models must handle sequential, continuous data deletion requests over time under continual learning settings.

Summary updated

Abstract

Machine unlearning has been extensively studied in response to growing privacy concerns and regulatory requirements. However, auditing whether unlearning algorithms have truly erased the influence of specific data remains an open challenge. The lack of reliable and practical auditing mechanisms can lead to critical privacy risks, such as residual information leakage. This paper initiates a systematic investigation into whether existing unlearning algorithms can truly forget the designated data. We propose the first practical and general-purpose auditing framework for machine unlearning, inspired by the concept of proof of ignorance. Our framework addresses the key practicality limitations of existing methods by eliminating the need for retraining-from-scratch baselines, avoiding the training of large numbers of shadow models, and requiring no intrusive intervention in the original training process. To evaluate the effectiveness of our framework, we first conduct validation experiments to verify its soundness and completeness. We then perform comprehensive experiments across six datasets and ten representative unlearning methods. The results demonstrate that our framework reliably distinguishes between successful and failed unlearning. In particular, we observe that retraining-based and fine-tuning-based methods can achieve effective unlearning, even when the target data remain in the original dataset. In contrast, de-optimization-based methods fail to achieve true unlearning and instead degrade the model's performance. Fisher/Hessian-based methods also fail to unlearn requested data, even formal certification is provided. Moreover, we show that our framework is robust against fake unlearning attempts and generalizes well to large language models.
BibTeX
@misc{ye2026auditing,
  author = {Dayong Ye and Tianqing Zhu and Ruiding Huang and Xinbo Fu and Jiayang Li and Bo Liu and Huan Huo and Wanlei Zhou},
  title = {{Auditing Machine Unlearning: A Systematic Research on Whether Models Truly Forget}},
  year = {2026},
  eprint = {2606.16110},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2606.16110},
}

Loading related content...

Figure