Early Prediction Model for Critical Illness of Hospitalized COVID-19 Patients Based on Machine Learning Techniques

Yacheng Fu, Weijun Zhong, Tao Liu, Jianmin Li, Kui Xiao, Xinhua Ma, Lihua Xie, Junyi Jiang, Hong‐Hao Zhou, Rong Liu, Wei ZhangFrontiers in Public Health 2022 · DOI

TL;DR

This paper presents a machine learning-based risk prediction model to identify hospitalized COVID-19 patients at high risk of developing critical illness early on. By analyzing laboratory data, the model achieved high accuracy in predicting critical outcomes, potentially improving patient management and resource allocation.

What Problem Does This Paper Address?

The COVID-19 pandemic has placed immense strain on healthcare systems worldwide. A significant challenge is the rapid deterioration of some patients from mild to critical illness, often requiring intensive care. Early identification of these high-risk patients is crucial for timely intervention, optimizing treatment, and managing limited healthcare resources effectively. While some risk factors for critical illness have been identified, a robust, objective, and easily applicable predictive model based on readily available data at hospital admission was lacking. This study aims to fill that gap by developing such a model.

Methods

The researchers employed a retrospective, multi-center cohort study design. They utilized Least Absolute Shrinkage and Selection Operator (LASSO) logistic regression as their primary machine learning technique. LASSO is particularly useful here because it performs both variable selection and regularization simultaneously, helping to identify the most predictive features while reducing overfitting, especially in datasets with many potential predictors.

The study involved two main phases:

  1. Model Development: A development cohort was used to identify potential risk factors and train the predictive model.
  2. External Validation: An independent cohort was used to test the generalizability and robustness of the developed model.

Beyond LASSO, the authors also explored other machine learning techniques like Support Vector Regression (SVR), Artificial Neural Network (ANN), Regression Tree (RT), and Multivariate Adaptive Regression Splines (MARS) for comparison, ultimately selecting LASSO for its interpretability and performance. They constructed a risk score based on the coefficients derived from the LASSO model, which was then used to calculate the probability of developing critical illness.

Datasets

  • Development Cohort: Data from 1,363 hospitalized COVID-19 patients across 4 hospitals in Hubei, China.
  • External Validation Cohort: Data from 566 hospitalized COVID-19 patients from 27 hospitals in Hunan province, China.

The study focused on laboratory findings measured within 2 days of hospital admission, along with demographic data.

Key Insights and Ideas

  • Objective Predictors are Key: Unlike some previous studies relying on patient self-reports, this work emphasizes objective laboratory markers, reducing recall bias and increasing reliability.
  • LASSO's Power for Feature Selection: The use of LASSO effectively sifted through numerous laboratory parameters to pinpoint the most significant predictors of critical illness, preventing the model from being overwhelmed by irrelevant data.
  • Early Warning System Potential: The developed risk score, based on readily available admission data, offers a practical tool for clinicians to stratify patients and allocate resources proactively.
  • Dynamic Changes Matter: While admission data is crucial, the study also explored longitudinal changes in laboratory findings, hinting at the potential for dynamic monitoring in future models.

Key Results

  • 28 Prognostic Factors Identified: Univariate analysis revealed 28 variables associated with critical illness.
  • High Predictive Accuracy: The LASSO-based risk score achieved an Area Under the Curve (AUC) of 0.83 in the development cohort and 0.84 in the external validation cohort, indicating strong discriminative ability.
  • Key Predictors: Significant predictors included age, elevated levels of CK-MB, neutrophils, PCT, α-HBDH, D-dimer, LDH, glucose, PT, APTT, RDW, fibrinogen, and AST. Conversely, lymphopenia, low basophil/eosinophil/thrombocyte counts, low red blood cell, hematocrit, hemoglobin, and decreased levels of K, Na, albumin, and uric acid were also associated with critical illness.
  • Model Performance: While ANN and SVR showed strong performance in the development cohort, LASSO logistic regression demonstrated superior and more robust performance in the external validation, making it the preferred choice.

Limitations and Future Work

  • Retrospective Design: The study is retrospective, which inherently has limitations compared to prospective studies.
  • Incomplete Data: Missing laboratory findings and the absence of CT scan data in the electronic database could have impacted statistical power. However, the model showed tolerance to missing data.
  • Generalizability: Data was collected from two provinces in China, and further studies on diverse populations are needed to confirm the generalizability of the risk model.
  • Data-Driven Models: The algorithms used are data-driven, meaning their performance might vary with different datasets.
  • Future Work: The authors suggest that incorporating more data and potentially exploring different populations could lead to even more accurate models. They also highlight the potential for using these models to optimize resource allocation and improve clinical strategies.

Summary updated

Abstract

A risk prediction model based on laboratory findings of patients with COVID-19 was developed for the early identification of patients at high risk of progression to critical illness. This cohort study identified 28 indicators associated with critical illness of patients with COVID-19. The risk model might contribute to the treatment of critical illness disease as early as possible and allow for optimized use of medical resources.
BibTeX
@inproceedings{fu2022early,
  author = {Yacheng Fu and Weijun Zhong and Tao Liu and Jianmin Li and Kui Xiao and Xinhua Ma and Lihua Xie and Junyi Jiang and Hong‐Hao Zhou and Rong Liu and Wei Zhang},
  title = {{Early Prediction Model for Critical Illness of Hospitalized COVID-19 Patients Based on Machine Learning Techniques}},
  booktitle = {Frontiers in Public Health},
  year = {2022},
  doi = {10.3389/fpubh.2022.880999},
}
Figure