How essential are unstructured clinical narratives and information fusion to clinical trial recruitment?

Preethi Raghavan, James L. Chen, Eric Fosler-Lussier, Albert M. LaiarXiv 2015 · arXiv

Abstract

Automating clinical trial recruitment is a critical challenge in medical informatics. This study evaluates the necessity of unstructured clinical narratives versus structured Electronic Health Record (EHR) data. Results indicate that unstructured data is indispensable, resolving up to 77% of eligibility criteria, particularly those involving complex temporal reasoning and information fusion.

Introduction

Clinical trial recruitment remains a manual, labor-intensive process, often serving as a primary bottleneck in medical research. While Electronic Health Records (EHRs) provide a wealth of patient data, this information is typically bifurcated into structured fields (e.g., lab results, ICD codes) and unstructured narratives (e.g., progress notes, discharge summaries). This research, conducted at The Ohio State University, empirically measures the information loss incurred when ignoring unstructured text, focusing on the roles of temporal reasoning and information fusion in determining trial eligibility.

Methodology

The researchers developed a systematic methodology to compare the resolvability of clinical trial criteria across different data sources. Using two primary cohorts—Chronic Lymphocytic Leukemia (CLL) and Prostate Cancer—the study analyzed the top 100 clinical trials for each disease.

Key components of the methodology included:

  • Concept Extraction: Medical concepts were identified using MetaMap and mapped to Unified Medical Language System (UMLS) identifiers.
  • Matching Logic: An algorithm was developed to verify if required trial concepts existed in structured data, unstructured narratives, or both.
  • Temporal Reasoning: To address time-sensitive criteria, a Conditional Random Field (CRF)-based time-bin tagger was employed to categorize events and construct chronological patient timelines across multiple documents.
  • Information Fusion: A framework was established to identify criteria requiring the integration of both structured and unstructured data sources.

Results and Discussion

The analysis revealed that structured EHR data is fundamentally insufficient for automated recruitment. Unstructured clinical narratives were essential for resolving 59% of CLL criteria and 77% of prostate cancer criteria.

Comparison of data match rates for CLL and Prostate Cancer datasets.

As illustrated in the table above, the reliance on unstructured data is particularly pronounced in prostate cancer, where structured data alone resolved only 9% of criteria. This "referral effect" suggests that for certain conditions, critical patient history often resides in text-heavy external reports rather than internal structured databases.

Furthermore, the study highlighted the complexity of clinical logic. A significant portion of criteria required reasoning across multiple narratives or the fusion of disparate data types.

Prevalence of cross-narrative temporal reasoning and information fusion requirements.

Approximately one-third of criteria necessitated cross-narrative temporal reasoning to establish a valid medical history. Information fusion was also vital, particularly for the CLL cohort, where 24% of criteria required overlapping information from both structured and unstructured sources.

Conclusion

This research demonstrates that unstructured clinical narratives are non-negotiable for effective automated clinical trial recruitment. Systems relying solely on structured EHR data miss the vast majority of relevant clinical context. Future advancements in recruitment automation must prioritize sophisticated Natural Language Processing (NLP) capabilities, specifically focusing on temporal reasoning, coreference resolution, and cross-source information fusion to bridge the gap between "clean" data and clinical reality.

Summary updated

Abstract

Electronic health records capture patient information using structured controlled vocabularies and unstructured narrative text. While structured data typically encodes lab values, encounters and medication lists, unstructured data captures the physician's interpretation of the patient's condition, prognosis, and response to therapeutic intervention. In this paper, we demonstrate that information extraction from unstructured clinical narratives is essential to most clinical applications. We perform an empirical study to validate the argument and show that structured data alone is insufficient in resolving eligibility criteria for recruiting patients onto clinical trials for chronic lymphocytic leukemia (CLL) and prostate cancer. Unstructured data is essential to solving 59% of the CLL trial criteria and 77% of the prostate cancer trial criteria. More specifically, for resolving eligibility criteria with temporal constraints, we show the need for temporal reasoning and information integration with medical events within and across unstructured clinical narratives and structured data.
BibTeX
@misc{raghavan2015how,
  author = {Preethi Raghavan and James L. Chen and Eric Fosler-Lussier and Albert M. Lai},
  title = {{How essential are unstructured clinical narratives and information fusion to clinical trial recruitment?}},
  year = {2015},
  eprint = {1502.04049},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1502.04049},
}
Figure