Interpretable Machine Learning Model Integrating Electrocardiographic and Acute Physiology Metrics for Mortality Prediction in Critical Ill Patients

Qiuyu Wang, Bin Wang, Bo Chen, Qing Li, Yutong Zhao, Tianyu Dong, Yifei Wang, Ping ZhangJournal of Clinical Medicine 2025 · DOI

TL;DR

This paper introduces the E3A score, a novel machine learning model that combines electrocardiogram (ECG) data with established clinical metrics (APS-III score and age) to predict 28-day mortality in critically ill ICU patients. By integrating ECG insights, the E3A score significantly improves mortality prediction accuracy, offering a more interpretable and actionable tool for early risk stratification in critical care.

What Problem Does This Paper Address?

Critically ill patients in the Intensive Care Unit (ICU) face a high risk of short-term mortality due to complex health conditions. Accurately predicting this risk is crucial for timely interventions and resource allocation. While existing scoring systems use physiological and laboratory data, they largely overlook electrocardiogram (ECG) data. ECGs are readily available, non-invasive, and provide dynamic insights into cardiac electrophysiology, which is known to significantly impact outcomes in critically ill patients. However, extracting meaningful prognostic information from ECGs has been challenging due to the complexity of interpretation and limitations in automated feature extraction. This paper aims to bridge this gap by developing an interpretable machine learning model that leverages ECG data alongside traditional clinical variables for improved mortality prediction.

Methods

The researchers employed a multi-stage approach:

  1. ECG-Derived Risk Score Generation: A deep residual convolutional neural network was used to extract features from the first ECG recorded upon ICU admission. This model was trained to generate an ECG-based risk score.
  2. Feature Selection: A comprehensive set of 85 candidate clinical and physiological variables was initially considered. Feature importance was assessed using XGBoost, SHapley Additive exPlanations (SHAP), and clinical relevance to identify key predictors.
  3. Model Development: A three-variable model, termed the E3A score, was developed, comprising the ECG-derived risk score, the APS-III score, and patient age. This model was then evaluated using four different machine learning algorithms: logistic regression, decision tree, random forest, and XGBoost.
  4. Model Evaluation: Performance was assessed using standard metrics like Area Under the Receiver Operating Characteristic Curve (AUC), calibration plots, Brier scores, and Decision Curve Analysis (DCA) to evaluate clinical utility.

Datasets

The study utilized the MIMIC-IV v2.2 database, a de-identified clinical dataset containing information from 299,712 patients from the Beth Israel Deaconess Medical Center between 2008 and 2019. The data was used for retrospective cohort analysis.

Key Insights and Ideas

  • Untapped Prognostic Value of ECG: The study strongly highlights that ECG data, often underutilized in critical care risk prediction, contains significant prognostic information. The ECG-derived risk score alone showed moderate predictive ability.
  • Synergistic Power of Multimodal Data: Integrating ECG data with established clinical scores (like APS-III) and demographic factors (age) led to a substantial improvement in mortality prediction compared to using any single modality alone.
  • Interpretability is Key: The use of SHAP values was crucial for understanding the contribution of each feature, ensuring that the final model was not only accurate but also interpretable, which is vital for clinical adoption.
  • Logistic Regression Reigns Supreme (for this task): Despite the power of ensemble methods like XGBoost and random forests, logistic regression provided the best balance of performance and interpretability for the final E3A score, outperforming more complex models in this specific context.
  • Age Matters: Even with sophisticated physiological and ECG metrics, age remained an independent and significant predictor of mortality, underscoring its fundamental role in critical illness outcomes.

Key Results

  • A total of 18,256 ICU patients were included in the final cohort, with 2412 deaths within 28 days (13.2%).
  • The ECG score was significantly higher in non-survivors (median [IQR]: 24.4 [15.6–33.4]) compared to survivors (13.5 [7.2–22.1], p < 0.001).
  • The final E3A score (ECG score, APS-III, age), implemented using logistic regression, achieved an AUC of 0.806 (95% CI: 0.784–0.826) on the test set and 0.804 (95% CI: 0.772–0.835) on the validation set.
  • The E3A score demonstrated superior clinical utility compared to traditional scoring systems, as indicated by Decision Curve Analysis (DCA).
  • Multivariable logistic regression confirmed the independent predictive value of ECG score (OR 1.06 per unit increase), age (OR 1.02 per year), and APS-III score (OR 1.04 per unit increase).

Limitations and Future Work

  • Single-Database Retrospective Analysis: The study relied on data from a single institution (MIMIC-IV), which may limit the generalizability of the findings to other ICUs with different patient populations, care pathways, or documentation standards.
  • Static Baseline Model: The model uses data from the initial ICU admission and the first ECG, creating a static baseline. It does not capture within-stay dynamics or evolving patient physiology.
  • Complete-Case Analysis: While XGBoost handled missingness during variable screening, the final parsimonious score used complete-case analysis, which could exclude sicker patients and distort calibration.
  • Threshold Dependence: The model's performance is threshold-dependent, and site-specific re-thresholding or recalibration may be necessary.
  • ECG Heterogeneity: Variations in ECG acquisition and preprocessing could impact the learned ECG risk representation.

Future Work: The authors suggest several directions:

  • External, Multicenter Validation: To establish generalizability and assess fairness across diverse settings.
  • Prospective Evaluation: To monitor model drift, alert volume, and workflow integration in real-world clinical settings.
  • Explainability Enhancement: Further research into explainability techniques (e.g., saliency mapping) to pinpoint specific ECG characteristics contributing most to risk prediction.
  • EHR Integration: Developing lightweight EHR modules for seamless integration and automated data retrieval.
  • Dynamic Modeling: Exploring models that can incorporate within-stay physiological changes for more dynamic risk assessment.

Summary updated

Abstract

<b>Background</b>: Critically ill patients in the intensive care unit (ICU) are characterized by complex comorbidities and a high risk of short-term mortality. Traditional severity scoring systems rely on physiological and laboratory variables but lack direct integration of electrocardiogram (ECG) data. This study aimed to construct an interpretable machine learning (ML) model combining ECG-derived and clinical variables to predict 28-day mortality in ICU patients. <b>Methods</b>: A retrospective cohort analysis was performed with data from the MIMIC-IV v2.2 database. The primary outcome was 28-day mortality. An ECG-based risk score was generated from the first ECG after ICU admission using a deep residual convolutional neural network. Feature selection was guided by XGBoost importance ranking, SHapley Additive exPlanations, and clinical relevance. A three-variable model comprising ECG score, APS-III score, and age (termed the E3A score) was developed and evaluated across four ML algorithms. We evaluated model performance by calculating the AUC of ROC curves, examining calibration, and applying decision curve analysis. <b>Results</b>: A total of 18,256 ICU patients were included, with 2412 deaths within 28 days. The ECG score was significantly higher in non-survivors than in survivors (median [IQR]: 24.4 [15.6-33.4] vs. 13.5 [7.2-22.1], <i>p</i> < 0.001). Logistic regression demonstrated the best discrimination for the E3A score, achieving an AUC of 0.806 (95% CI: 0.784-0.826) for the test set and 0.804 (95% CI: 0.772-0.835) for the validation set. <b>Conclusions</b>: Integrating ECG-derived features with clinical variables improves prognostic accuracy for 28-day mortality prediction in ICU patients, supporting early risk stratification in critical care.
BibTeX
@article{wang2025interpretable,
  author = {Qiuyu Wang and Bin Wang and Bo Chen and Qing Li and Yutong Zhao and Tianyu Dong and Yifei Wang and Ping Zhang},
  title = {{Interpretable Machine Learning Model Integrating Electrocardiographic and Acute Physiology Metrics for Mortality Prediction in Critical Ill Patients}},
  journal = {Journal of Clinical Medicine},
  year = {2025},
  doi = {10.3390/jcm14207163},
}
Figure