Clinical Predictive Models for COVID-19: Systematic Study

Patrick Schwab, August DuMont Schütte, Benedikt Dietz, Stefan Bauer

TL;DR

This study develops machine learning models to predict COVID-19 test results and patient severity (hospitalization and ICU needs) using only routinely collected clinical and blood data. By achieving high predictive accuracy for severe cases—up to a 0.98 AUC for ICU admission—these models offer a data-driven way to prioritize scarce healthcare resources during pandemic surges.

What Problem Does This Paper Address?

The COVID-19 pandemic created unprecedented demand for diagnostic tests, hospital beds, and intensive care units (ICUs). Healthcare systems urgently needed tools to stratify patients by risk to ensure those most in need received care first. However, early in the pandemic, the specific clinical markers that reliably predicted severe outcomes were not fully established, and clinical datasets were often plagued by high rates of missing information. This paper seeks to fill that gap by systematically evaluating how well standard machine learning models can predict clinical pathways using routine, often incomplete, hospital data.

Methods

The authors implemented a robust multistage machine-learning pipeline designed to handle the messiness of real-world clinical data.

Fig. 2: The presented multistage machine-learning pipeline consists of preprocessing (light purple) the input data x, developing multiple candidate models using the given dataset (orange), selecting the best candidate model for evaluation (blue), and evaluating the selected best model’s outputs ˆy.

Key technical components included:

  • Preprocessing for Missingness: Features with >99.8% missingness were discarded. Continuous variables were imputed using Multiple Imputation by Chained Equations (MICE). Crucially, they added a "missing indicator" feature to preserve the information that a value was originally absent, which proved to be highly predictive.
  • Model Diversity: The study compared five different algorithms: Logistic Regression (LR), Neural Networks (NN), Random Forest (RF), Support Vector Machines (SVM), and Gradient Boosting (XGB).
  • Rigorous Evaluation: A stratified split (50% train, 20% validation, 30% test) ensured that models were tested on entirely unseen patients, preventing overfitting.
  • Interpretability: The team used CXPlain, a causal explanation method, to quantify the marginal contribution of each clinical feature to the models' decisions.

Datasets

The study utilized an anonymized dataset of 5,644 patients from the Hospital Israelita Albert Einstein in São Paulo, Brazil, collected during the early months of 2020. The dataset included 106 routine clinical, laboratory, and demographic measurements, such as blood counts (leukocytes, platelets), metabolic markers (creatinine, glucose), and patient age.

Key Insights and Ideas

  • The "Missingness" Signal: One of the most striking findings was that the absence of certain tests was a powerful predictor. For instance, whether or not an Arterial Lactic Acid test was ordered accounted for over 70% of the importance in the model predicting test results. This suggests that clinical judgment—a doctor's decision that a patient doesn't look sick enough to need a specific test—is a valuable latent feature.
  • Severity is Easier to Predict than Diagnosis: The models were significantly more accurate at predicting hospitalization and ICU needs than at predicting whether a patient would test positive for SARS-CoV-2. This indicates that while COVID-19 symptoms can mimic other respiratory illnesses, its severe physiological impact on blood chemistry and organ function is distinct.
  • Routine Labs are Sufficient: High performance was achieved using standard blood work (leukocytes, platelets, LDH) without needing specialized COVID-19 biomarkers. This makes the models highly deployable in standard clinical settings worldwide.

Key Results

The models demonstrated excellent performance, particularly for high-stakes outcomes:

  • ICU Admission: The SVM model achieved a near-perfect AUC of 0.98, with 80% sensitivity and 96% specificity.
  • Hospitalization: The Random Forest model reached an AUC of 0.92.
  • SARS-CoV-2 Diagnosis: The XGB model was less precise but still useful, with an AUC of 0.66 and a sensitivity of 75%.
ROC curves for the best models across the three tasks: diagnosis, hospitalization, and critical care.

Feature importance analysis confirmed that markers like Lactic Dehydrogenase (LDH) and leukocyte counts were top predictors for severity, while missingness indicators dominated diagnosis prediction.

Top-10 features for predicting SARS-CoV-2 test results, highlighting the importance of missingness.

Limitations and Future Work

The primary limitation is that the data comes from a single hospital site, meaning the specific "missingness" patterns and clinical practices might not generalize to other regions with different testing guidelines. Additionally, the study lacked mortality data, preventing the models from predicting the most critical outcome: patient death.

The authors suggest that future work should focus on multi-center validation and the integration of other data modalities, such as medical imaging (chest X-rays/CT) and genomic profiling, to further refine these predictive clinical pathways.

Summary updated

Abstract

Coronavirus Disease 2019 (COVID-19) is a rapidly emerging respiratory disease caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Due to the rapid human-to-human transmission of SARS-CoV-2, many healthcare systems are at risk of exceeding their healthcare capacities, in particular in terms of SARS-CoV-2 tests, hospital and intensive care unit (ICU) beds and mechanical ventilators. Predictive algorithms could potentially ease the strain on healthcare systems by identifying those who are most likely to receive a positive SARS-CoV-2 test, be hospitalised or admitted to the ICU. Here, we study clinical predictive models that estimate, using machine learning and based on routinely collected clinical data, which patients are likely to receive a positive SARS-CoV-2 test, require hospitalisation or intensive care. To evaluate the predictive performance of our models, we perform a retrospective evaluation on clinical and blood analysis data from a cohort of 5644 patients. Our experimental results indicate that our predictive models identify (i) patients that test positive for SARS-CoV-2 a priori at a sensitivity of 75% (95% CI: 67%, 81%) and a specificity of 49% (95% CI: 46%, 51%), (ii) SARS-CoV-2 positive patients that require hospitalisation with 0.92 AUC (95% CI: 0.81, 0.98), and (iii) SARS-CoV-2 positive patients that require critical care with 0.98 AUC (95% CI: 0.95, 1.00). In addition, we determine which clinical features are predictive to what degree for each of the aforementioned clinical tasks. Our results indicate that predictive models trained on routinely collected clinical data could be used to predict clinical pathways for COVID-19, and therefore help inform care and prioritise resources.
BibTeX
@misc{schwab2020clinical,
  author = {Patrick Schwab and August DuMont Schütte and Benedikt Dietz and Stefan Bauer},
  title = {{Clinical Predictive Models for COVID-19: Systematic Study}},
  year = {2020},
  eprint = {2005.08302},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2005.08302},
}
Figure