Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis

Maximilian Dietrich, Silvia Seidlitz, Nicholas Schreck, Manuel Wiesenfarth, Patrick Godau, Minu Tizabi, Jan Sellner, Sebastian Marx, Samuel Knödler, Michael M. Allers, Leonardo Ayala, Karsten Schmidt, Thorsten Brenner, Alexander Studier-Fischer, Felix Nickel, Beat P. Müller-Stich, Annette Kopp-Schneider, Markus A. Weigand, Lena Maier-HeinarXiv 2021 · OpenReview

TL;DR

This paper explores the use of hyperspectral imaging (HSI) and machine learning for automated sepsis diagnosis, achieving over 98% accuracy on an existing dataset. Crucially, it also identifies and analyzes potential confounding factors in HSI data that could lead to overestimating diagnostic performance, highlighting the need for careful study design in future research.

What Problem Does This Paper Address?

Sepsis is a life-threatening condition with high mortality, and its early detection is critical for effective treatment. However, robust biomarkers for rapid sepsis diagnosis are still lacking. Recent research suggests that hyperspectral imaging (HSI), which captures detailed spectral information from tissues, might be useful for monitoring microcirculatory changes associated with sepsis. Despite this potential, the application of automated machine learning (ML) techniques for sepsis diagnosis using HSI data has not been systematically investigated. This paper aims to fill this gap by exploring the feasibility of ML-based sepsis diagnosis with HSI and, importantly, by identifying and analyzing potential confounding factors that could bias the results.

Methods

The researchers employed Linear Discriminant Analysis (LDA), a classical statistical method for classification, to build their sepsis diagnostic model. They trained and tested the LDA classifier using median spectra derived from hyperspectral images. To ensure robust performance estimation and mitigate bias from a single test set, they utilized a large number of random train-test splits generated through bootstrap subsampling (500,000 splits). This approach allowed them to evaluate the classifier's performance across various settings, including different measurement sites (hand, thigh, or both) and time points (all available data vs. only initial measurements). A significant portion of the study was dedicated to a systematic analysis of potential confounders, categorizing them into subject-related (static and dynamic), therapy-related, and imaging-related factors.

Datasets

The study utilized an existing dataset acquired at Heidelberg University Hospital. This dataset comprised HSI data from:

  • 25 healthy subjects
  • 25 patients with sepsis or septic shock
  • 25 patients undergoing pancreatic surgery

For healthy subjects, HSI data was acquired at a single time point. For sepsis and pancreatic surgery patients, HSI data was collected over an approximately 72-hour observation period, with defined acquisition time points. In addition to HSI data, extensive clinical data was documented for these subjects, including demographics, hemodynamic monitoring, laboratory parameters, and more.

Key Insights and Ideas

  • HSI shows promise for sepsis diagnosis: The study demonstrates that ML can achieve high accuracy in classifying sepsis using HSI data, suggesting HSI's potential as a diagnostic tool.
  • Median spectra are more informative than tissue parameters: The analysis revealed that using median spectral data for classification yielded better separation of subject groups compared to using derived tissue parameters (like StO2, perfusion index, etc.). This highlights the richness of raw spectral information.
  • Confounding factors are critical: The paper strongly emphasizes that factors beyond the actual disease state can significantly influence HSI measurements and lead to inflated performance metrics. This is a crucial takeaway for anyone working with medical imaging data and ML.
  • Subject, therapy, and imaging all play a role: The identification of distinct categories of confounders (subject demographics/health, treatment interventions, and imaging acquisition specifics) provides a structured framework for understanding potential biases.

Key Results

  • High Classification Accuracy: The LDA classifier achieved an accuracy of over 98% in classifying sepsis from the available HSI data.
  • Measurement Site Performance: Similar accuracy, sensitivity, and specificity were observed when training/testing on "both" hand and thigh sites, or just the "hand" site. However, performance dropped when using only "thigh" spectra.
  • Time Point Analysis: The classifier maintained high performance (accuracy ~0.98) whether testing on all available time points or just the initial measurement at inclusion, suggesting early detection capabilities.
  • Confounder Identification: The study identified several potential confounders, including age distribution shifts between groups, variations in Hb concentration, fluid balance, vasoactive-inotropic score (VIS), and even software updates during data acquisition. For instance, a significant difference in age distribution between healthy volunteers and sepsis/pancreatic surgery patients was noted as a potentially strong confounder.

Limitations and Future Work

The authors acknowledge that the study was conducted on a single, previously published dataset. While they achieved high accuracy, they emphasize that these are preliminary results. A significant limitation is the potential overestimation of algorithm performance due to the identified confounders.

Future work should focus on:

  • Prospective Studies: Conducting larger, prospective studies that are carefully designed to account for the identified confounders.
  • Systematic Confounder Analysis: Performing independent studies specifically to analyze the impact of imaging-related confounders like hand postures and camera perspectives.
  • Extended Data Collection: Expanding the dataset with a more comprehensive sample size and including patients earlier in the sepsis progression.
  • Data Fusion: Combining HSI data with continuous recording of other digital patient data to explore potential synergies and compare diagnostic capabilities.
  • Advanced ML Models: Exploring more sophisticated ML methods like deep learning or random forests if LDA proves insufficient in future studies with better-controlled confounders.

Summary updated

Abstract

Sepsis is a leading cause of mortality and critical illness worldwide. While robust biomarkers for early diagnosis are still missing, recent work indicates that hyperspectral imaging (HSI) has the potential to overcome this bottleneck by monitoring microcirculatory alterations. Automated machine learning-based diagnosis of sepsis based on HSI data, however, has not been explored to date. Given this gap in the literature, we leveraged an existing data set to (1) investigate whether HSI-based automated diagnosis of sepsis is possible and (2) put forth a list of possible confounders relevant for HSI-based tissue classification. While we were able to classify sepsis with an accuracy of over $98\,\%$ using the existing data, our research also revealed several subject-, therapy- and imaging-related confounders that may lead to an overestimation of algorithm performance when not balanced across the patient groups. We conclude that further prospective studies, carefully designed with respect to these confounders, are necessary to confirm the preliminary results obtained in this study.
BibTeX
@misc{dietrich2021machine,
  author = {Maximilian Dietrich and Silvia Seidlitz and Nicholas Schreck and Manuel Wiesenfarth and Patrick Godau and Minu Tizabi and Jan Sellner and Sebastian Marx and Samuel Knödler and Michael M. Allers and Leonardo Ayala and Karsten Schmidt and Thorsten Brenner and Alexander Studier-Fischer and Felix Nickel and Beat P. Müller-Stich and Annette Kopp-Schneider and Markus A. Weigand and Lena Maier-Hein},
  title = {{Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis}},
  year = {2021},
  eprint = {2106.08445},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2106.08445},
}
Figure