NPRL: Nightly Profile Representation Learning for Early Sepsis Onset Prediction in ICU Trauma Patients

Tucker Stewart, Katherine Stern, Grant E. O'Keefe, Ankur Teredesai, Juhua Hu

TL;DR

NPRL (Nightly Profile Representation Learning) is a novel framework designed to predict sepsis onset in ICU trauma patients by analyzing data collected during the "quiet" night shift (10 PM – 6 AM). By using self-supervised pre-training to learn unique patient profiles, the model successfully overcomes the extreme class imbalance—where sepsis cases make up less than 2% of the data—significantly outperforming standard clinical baselines in early detection.

What Problem Does This Paper Address?

Sepsis is a life-threatening immune overreaction to infection and a leading cause of death in ICUs. While early antibiotic treatment is effective, early detection is notoriously difficult, especially in trauma patients where injury-related inflammation often masks the clinical signs of infection.

The authors identify two major gaps in current AI research for sepsis:

  1. Unrealistic Evaluation: Many models are trained using "fixed time to onset" (e.g., looking back 24 hours from a known sepsis event), which is impossible to use in real-time because the onset time isn't known beforehand.
  2. The Rare Event Problem: In a real-world daily screening setup, the number of "healthy" patient-days vastly outweighs the "sepsis" days. Standard machine learning models often take the easy way out by predicting "no sepsis" for everyone, achieving high accuracy while being clinically useless.

Methods

The researchers propose a Nightly Profile Representation Learning (NPRL) approach.

  • The Prediction Setup: Instead of constant monitoring, the model mimics a diagnostic test. It analyzes data from the previous night (10 PM to 6 AM) to predict if sepsis will occur within the next 24 hours. This timing is strategic: night shifts have lower staff-to-patient ratios, and the "quiet" period reflects the patient's actual physiology with fewer external interruptions.
  • The Architecture: They use a Multi-modal RNN. A Bidirectional Gated Recurrent Unit (GRU) processes temporal data (vitals and labs), while a deep dense network handles static data (age, injury type).
  • Self-Supervised Learning: This is the core innovation. Before training on sepsis labels, the model is trained to uniquely identify each specific "patient-night" profile. This forces the model to learn a diverse latent space. When the model is later fine-tuned for sepsis prediction, this diversity prevents the rare sepsis cases from being "swallowed" by the overwhelming majority of non-sepsis cases.

Datasets

The study utilized de-identified Electronic Health Record (EHR) data from UW Medicine Harborview Medical Center, a Level-1 trauma center.

  • Scope: 2,802 patients admitted between 2012 and 2019.
  • Sepsis Rate: While 17% of patients eventually developed sepsis, the daily instance rate was less than 2%, creating a severe class imbalance.
  • Features: Data was categorized into three subsets: hourly vitals (Subset 1), static demographics and initial ED physiology (Subset 2), and cumulative exposures like IV fluids and ventilator days (Subset 3).

Key Insights and Ideas

  • The "Aha" Moment for Imbalance: The authors mathematically prove (Theorem 1) that by forcing the model to distinguish between every individual patient profile first, they can preserve the "diversity" of the data. This prevents the model's weights from collapsing into a state where it only recognizes the majority class.
  • Night Data is Better: The authors argue that nighttime data is a "cleaner" signal of a patient's state because there are fewer diagnostic procedures and interventions compared to the busy daytime hours.
  • Temporal > Static: The results showed that cumulative temporal patterns (like fluid bolus volume and ventilator days) were far more predictive of sepsis than static factors like age or the initial mechanism of injury.

Key Results

NPRL demonstrated superior performance across several metrics compared to traditional methods like XGBoost and standard RNNs:

  • AUROC: NPRL achieved 0.7870, outperforming the standard RNN (0.7794) and XGBoost (0.7398).
  • Sensitivity (Recall): NPRL reached 0.8280, meaning it caught nearly 83% of sepsis cases. This is a significant jump over the standard RNN's 0.7346.
  • Clinical Utility: By delivering predictions at 6 AM, the model acts as a "pre-screening assistant" for clinicians during morning rounds, providing a high-sensitivity alert when staffing is most prepared to act.

Limitations and Future Work

  • Specificity Trade-off: While the model is excellent at catching sepsis (high sensitivity), it has a lower specificity (0.6120), meaning it produces more false positives than some other models. In an ICU, this could contribute to "alarm fatigue," though the authors argue sensitivity is more critical for screening.
  • Single-Center Study: The model was trained and tested on data from one hospital. The authors note that external validation on datasets like MIMIC-III is difficult because those datasets often lack the precise timestamps required for their specific "nightly" definition.
  • Future Directions: The team plans to explore data augmentation techniques (common in computer vision) to further improve EHR-based representation learning.

Summary updated

Abstract

Sepsis is a syndrome that develops in response to the presence of infection. It is characterized by severe organ dysfunction and is one of the leading causes of mortality in Intensive Care Units (ICUs) worldwide. These complications can be reduced through early application of antibiotics, hence the ability to anticipate the onset of sepsis early is crucial to the survival and well-being of patients. Current machine learning algorithms deployed inside medical infrastructures have demonstrated poor performance and are insufficient for anticipating sepsis onset early. In recent years, deep learning methodologies have been proposed to predict sepsis, but some fail to capture the time of onset (e.g., classifying patients' entire visits as developing sepsis or not) and others are unrealistic to be deployed into medical facilities (e.g., creating training instances using a fixed time to onset where the time of onset needs to be known apriori). Therefore, in this paper, we first propose a novel but realistic prediction framework that predicts each morning whether sepsis onset will occur within the next 24 hours with the help of most recent data collected at night, when patient-provider ratios are higher due to cross-coverage resulting in limited observation to each patient. However, as we increase the prediction rate into daily, the number of negative instances will increase while that of positive ones remain the same. Thereafter, we have a severe class imbalance problem, making a machine learning model hard to capture rare sepsis cases. To address this problem, we propose to do nightly profile representation learning (NPRL) for each patient. We prove that NPRL can theoretically alleviate the rare event problem. Our empirical study using data from a level-1 trauma center further demonstrates the effectiveness of our proposal.
BibTeX
@inproceedings{stewart2023nprl,
  author = {Tucker Stewart and Katherine Stern and Grant E. O'Keefe and Ankur Teredesai and Juhua Hu},
  title = {{NPRL: Nightly Profile Representation Learning for Early Sepsis Onset Prediction in ICU Trauma Patients}},
  booktitle = {IEEE Big Data},
  year = {2023},
  doi = {10.1109/bigdata59044.2023.10386180},
}

Loading related content...

Figure