DeepAlerts: Deep Learning Based Multi-Horizon Alerts for Clinical Deterioration on Oncology Hospital Wards

Dingwen Li, Patrick G. Lyons, Chenyang Lu, Marin KollefAAAI 2020 · DOI

Introduction

Hospitalized oncology patients are at high risk for sudden clinical deterioration, yet current Early Warning Systems (EWS) often fail to provide the precision and lead time necessary for effective intervention. Traditional scores like the Modified Early Warning Score (MEWS) frequently trigger false alarms, leading to "alarm fatigue." Furthermore, clinicians require multi-horizon alerts—differentiating between immediate threats (6 hours) and impending instability (24 or 48 hours)—to triage care effectively. DeepAlerts addresses these challenges through a novel multi-task deep learning framework.

Methods: Multi-Task Learning for Multi-Horizon Alerts

DeepAlerts utilizes a deep multi-task learning (MTL) architecture designed to predict deterioration across three distinct time horizons simultaneously. The model employs shared hidden layers to extract general patient representations, followed by task-specific layers for each horizon.

DeepAlerts Multi-Task Learning Architecture

Two primary innovations enhance this architecture:

  1. Prior Knowledge Regularization: Using a Graph Laplacian-based penalty, the model enforces "task relatedness," ensuring that predictions for related time horizons (e.g., 6h and 24h) remain logically consistent.
  2. Analytic Loss Balancing: To prevent one task from dominating the learning process, the authors introduced a closed-form analytic solution for balancing task-specific losses, significantly improving computational efficiency over iterative methods like GradNorm.

Data and Performance

The model was validated using a large-scale EHR dataset from Barnes-Jewish Hospital, encompassing over 20,700 oncology hospitalizations. DeepAlerts (specifically the DMNNpb variant) significantly outperformed traditional benchmarks. It achieved an AUROC of 0.949 for 24-hour alerts and 0.934 for 48-hour alerts. Crucially, at a specificity of 0.95, DeepAlerts maintained a precision of 0.706, nearly four times higher than the MEWS score (0.188).

Clinical Logic and Interpretability

A key contribution of DeepAlerts is its focus on "sequence concordance." In clinical settings, patient status typically evolves gradually. DeepAlerts is designed to favor "expected" alert sequences, where a high-risk state persists logically over time rather than flickering inconsistently.

Expected vs. Unexpected Alert Sequences

The model achieved a three-alert concordance of 77.58%. Additionally, the use of Layer-wise Relevance Propagation (LRP) allows clinicians to see which features—such as heart rate entropy or respiratory rate energy—most influenced a specific alert, moving away from "black box" predictions.

Conclusion

DeepAlerts demonstrates that incorporating clinical prior knowledge and efficient multi-task balancing can drastically improve the reliability of clinical alerts. While currently focused on oncology and validated retrospectively, the framework provides a robust foundation for future real-time clinical decision support systems.

Summary updated

BibTeX
@inproceedings{li2020deepalerts,
  author = {Dingwen Li and Patrick G. Lyons and Chenyang Lu and Marin Kollef},
  title = {{DeepAlerts: Deep Learning Based Multi-Horizon Alerts for Clinical Deterioration on Oncology Hospital Wards}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2020},
  doi = {10.1609/aaai.v34i01.5417},
}
Figure