Executive Summary
While large-scale Electronic Health Records (EHRs) offer a significant opportunity for studying long COVID, relying solely on diagnostic codes like ICD-10 (U09.9) is often inaccurate. This study demonstrates that fewer than half of patients assigned a long-COVID code actually meet clinical definitions. To capture the true complexity of the syndrome, researchers must leverage Natural Language Processing (NLP) and machine learning to analyze clinical narratives rather than relying on structured data alone.
Introduction: The Complexity of Long COVID
Researchers are increasingly utilizing "real-world data"—the massive datasets generated by everyday healthcare interactions—to understand post-acute sequelae of SARS-CoV-2 (PASC), commonly known as long COVID. However, long COVID is not a simple, single-organ disease; it is a "constellation of symptoms" ranging from cognitive impairment ("brain fog") to extreme fatigue.
The study identifies three primary hurdles in using EHR data for this purpose:
- Coding Ambiguity: The diagnostic code for long COVID (U09.9) is used inconsistently by clinicians.
- Symptom Silencing: Standardized codes often fail to capture non-specific symptoms like fatigue, which are frequently documented in text-based clinician notes rather than structured checkboxes.
- Systemic Bias: Data density varies significantly; patients visiting specialized long-COVID clinics have much more detailed records than those seeing general practitioners, creating an artificial divide in how the disease is represented in datasets.
Methodology
The study was conducted by the 4CE Consortium, an international group specializing in EHR data. To validate the reliability of real-world data, the researchers performed a manual medical-record review—the clinical "gold standard"—of 300 randomly sampled individuals across three major US health systems: Beth Israel Deaconess Medical Center, University of Pittsburgh Medical Center (UPMC), and the US Veterans Health Administration (VA).
These manual reviews were compared against two major operational definitions:
- WHO Definition: At least two new-onset persistent symptoms lasting for 60 days post-infection.
- CDC Definition: At least one new-onset persistent symptom lasting for 30 days post-infection.
The researchers also evaluated the effectiveness of simple ICD-10 code searches against Natural Language Processing (NLP) of clinical narratives, such as discharge summaries and physician notes, to determine which method better identified the syndrome.
Key Insights: Beyond the Diagnostic Code
The ICD-10 Code as a Weak Proxy
The study found that the presence of the U09.9 code is an "unreliable surrogate" for research. Simply having the code does not guarantee that a patient meets clinical standards for long COVID.
The "Hospitalization Trap"
Approximately 12.3% of patients with the long-COVID code had previously received intensive care. The physical and psychological toll of a long ICU stay can mimic long-COVID symptoms, leading to potential misattribution where the virus itself is blamed for symptoms caused by the severity of the initial acute illness.
The Importance of Narrative Data
Symptoms such as "brain fog" are rarely captured in structured codes but are frequently mentioned in clinical notes. Incorporating narrative data via NLP substantially improved the identification of symptoms compared to using diagnosis codes alone.
Data Density Bias
Patients at specialty long-COVID clinics often appear "sicker" in the data, not necessarily due to symptom severity, but because specialists document the syndrome more thoroughly. This "granularity gap" can confound research findings if not properly adjusted for in statistical models.
Quantitative Results
The discrepancy between coding and clinical reality is stark:
- Low Clinical Agreement: Among patients assigned the long-COVID ICD-10 code, only 40.2% met the strict WHO definition, and 65.4% met the broader CDC definition.
- The Specialty Gap: Only 24.0% of patients with a long-COVID code actually visited a specialty long-COVID clinic. Furthermore, of those who met the WHO definition, only 35.6% were seen at these specialty facilities.
- Under-reporting: 58.3% of patients with the U09.9 code had only a single symptom that met the WHO criteria, suggesting the code is often used as a catch-all for any lingering post-viral issue.
Conclusion and Future Directions
Defining the onset of long COVID is becoming increasingly difficult due to the prevalence of at-home testing, which is rarely recorded in EHRs. The authors suggest that researchers move toward using "infection time periods" rather than specific index dates.
The paper concludes by advocating for the development of "computational phenotypes." Instead of relying on a single diagnostic code, researchers should employ semi-supervised machine-learning algorithms to identify complex temporal patterns in the data. These models are better equipped to distinguish between pre-existing conditions and new-onset symptoms, leading to a more equitable and accurate understanding of long COVID.
Summary updated