What is the patient re-identification risk from using de-identified clinical free text data for health research?

Elizabeth Ford, Simon Pillinger, Robert Stewart, Kerina H. Jones, Angus Roberts, Arlene Casey, Katie Goddard, Goran NenadicAI Ethics 2025 · DOI

Introduction: The "Atrocious Waste" of Clinical Text

Electronic Health Records (EHRs) represent a vast, underutilized resource for medical advancement. These records are generally split into two domains: structured data (standardized codes for billing and diagnosis) and unstructured free text (the nuanced narrative of a patient's life, including doctor's notes and discharge summaries). For fields like mental health, the most valuable clinical insights are found almost exclusively in the text.

Despite its potential, data controllers often lock this text away due to privacy concerns. Unlike structured data, free text can contain "leaks"—names, addresses, or unique life events—that might identify a patient. However, current research suggests that by employing a layered security approach, the actual risk of patient re-identification is near zero. The continued non-use of this data has been described by patient representatives as an ethical "atrocious waste."

A Multi-Layered Defense: The Swiss Cheese Model

The paper advocates for a move away from the "lending library" model (where data is sent to researchers) toward a "reference library" model, where researchers access data within a Secure Data Environment (SDE). This strategy is best visualized through the "Swiss Cheese" model of data protection.

The Swiss Cheese model illustrates how multiple layers of protection—Safe Data, Safe Settings, Safe People, and Safe Outputs—work together to minimize re-identification risk.

In this model, no single layer of protection is perfect. Automated de-identification might have a small error rate, and an SDE might carry a marginal risk of a rogue researcher. However, when these "slices" of protection are stacked, the holes (risks) do not align. The four primary layers include:

  1. Safe Data (De-identification): Using methods ranging from traditional rule-based systems to modern Large Language Models (LLMs) like BERT and GPT-4. A key technique is Hidden in Plain Sight (HIPS), where real identifiers are replaced with realistic surrogates, making it impossible for an intruder to distinguish a "leak" from a "fake."
  2. Safe Setting (Secure Data Environment): Ensuring data never leaves a controlled digital perimeter.
  3. Safe People: Restricting access to accredited and trained analysts with full audit trails.
  4. Safe Projects and Outputs: Ensuring research results are checked for privacy leaks before they are released to the public.

Quantifying Risk and Performance

Modern de-identification algorithms have reached a high level of maturity, consistently achieving 97% to 99% recall and precision. When evaluating the empirical risk, the paper notes that attacking free text is manual, labor-intensive, and does not scale, making it a far less attractive target for malicious actors than structured databases, which are vulnerable to large-scale "linkage attacks."

Research into real-world implementations, such as the UK’s Clinical Record Interactive Search (CRIS)—which contains data from 1.3 million residents—shows a remarkable safety record. To date, there are no documented cases in the UK of a patient being harmed or re-identified through the legitimate use of de-identified clinical text in a research environment. One study even quantified the re-identification rate as low as 0.00013.

The Ethical Imperative and Future Outlook

Restricting research to structured data creates an "unintended discrimination" against clinical specialties like psychiatry, where text is the primary data source. Public engagement indicates that patients generally support the use of their text data for research, provided there is transparency and a clear "social license" to operate.

While the field is advancing, several challenges remain. Most algorithms are currently trained on a limited set of datasets, such as MIMIC-III, creating a need for more diverse, multi-lingual training corpora. Additionally, while LLMs show great promise, their use in clinical settings requires more rigorous validation. The authors suggest the creation of "donated" clinical text databanks to bypass regulatory hurdles for initial model training.

Ultimately, the evidence suggests that the risk of re-identification is manageable. The primary barrier to life-saving research is no longer technical, but a matter of data governance and the willingness to implement robust, layered security frameworks.

Summary updated

BibTeX
@article{ford2025what,
  author = {Elizabeth Ford and Simon Pillinger and Robert Stewart and Kerina H. Jones and Angus Roberts and Arlene Casey and Katie Goddard and Goran Nenadic},
  title = {{What is the patient re-identification risk from using de-identified clinical free text data for health research?}},
  journal = {AI Ethics},
  year = {2025},
  doi = {10.1007/s43681-025-00681-0},
}
Figure