AI-Based Detection of Oral Squamous Cell Carcinoma with Raman Histology

Andreas Weber, Kathrin Enderle-Ammour, Konrad Kurowski, Marc Christian Metzger, Philipp Poxleitner, Martin Werner, René Rothweiler, Jürgen Beck, Jakob Straehle, Rainer Schmelzeisen, David Steybe, Peter BronsertCancers 2024 · DOI

TL;DR

This paper explores the use of AI, specifically deep learning, to analyze images generated by Stimulated Raman Histology (SRH) for the real-time detection of oral squamous cell carcinoma (OSCC) and its surrounding tissues. The study demonstrates that this AI-powered approach can accurately identify different tissue types directly from SRH images, offering a promising avenue for faster intraoperative decision-making during cancer surgery.

What Problem Does This Paper Address?

Currently, surgeons rely on traditional H&E-stained frozen sections to evaluate surgical margins during oral cancer surgery. This process involves freezing, sectioning, staining, and microscopic examination by a pathologist, which can be time-consuming and introduce delays. The goal is to find a faster, intraoperative method that provides real-time feedback on resection status, enabling surgeons to make immediate decisions about extending the resection if tumor-positive margins are detected. Stimulated Raman Histology (SRH) offers a potential solution by generating tissue images without staining, but its interpretation still requires pathological expertise. This paper addresses the gap of efficiently interpreting these SRH images in real-time for OSCC detection.

Methods

The core of this research lies in applying deep learning to analyze SRH images. The researchers used a VGG19-based convolutional neural network (CNN) architecture, chosen for its proven performance on histology slides. The CNN was trained to classify six different tissue types: tumor, stroma, adipose tissue, muscle, squamous epithelium, and glandular tissue. To prepare the data for the CNN, the raw Stimulated Raman Scattering (SRS) images, which contain spectral information about lipids and proteins, were transformed into SRH images that visually resemble traditional H&E-stained sections. The study also compared the performance of the AI model on both the original SRS images and the transformed SRH images. To handle the inherent class imbalance in the dataset, a weighted loss function was employed during training.

Datasets

The study utilized 80 SRH images obtained from 8 OSCC patients. These images were meticulously annotated by experienced pathologists to identify six distinct tissue types. The annotated images were then divided into tiles of 250x250 pixels. The final dataset comprised 21,703 tiles, with a distribution of: 4892 tumor, 4902 stroma, 1471 adipose tissue, 756 muscle, 8461 squamous epithelium, and 1221 glandular tissue tiles. This dataset was split into a training set (64 images, 80%), a validation set (10% of training), and a test set (16 images, 20%).

Key Insights and Ideas

  • SRH as a Staining-Free Histology Alternative: SRH's ability to generate H&E-like images without chemical staining is a significant advantage, potentially streamlining the workflow and reducing artifact introduction.
  • Deep Learning for Real-Time Pathology: The study highlights the power of deep learning to automate the interpretation of complex biological data, moving towards real-time diagnostic capabilities in surgical settings.
  • SRS vs. SRH Performance: While both SRS and SRH images yielded strong results, the paper shows that the AI model's performance was comparable, with a slight outperformance on SRS images in terms of balanced accuracy. This suggests that the visual transformation into SRH doesn't significantly hinder AI interpretation.
  • Addressing Class Imbalance: The successful application of a weighted loss function demonstrates an effective strategy for training AI models on datasets with uneven representation of different tissue types, a common challenge in medical imaging.

Key Results

The AI model achieved a high overall balanced accuracy of 0.90 on SRS images and 0.87 on SRH images. Specific tissue types showed excellent performance:

  • Adipose tissue: Precision of 0.97 (SRS) / 0.99 (SRH) and Recall of 0.98 (SRS) / 0.94 (SRH).
  • Stroma: Precision of 0.90 (SRS) / 0.90 (SRH) and Recall of 0.91 (SRS) / 0.92 (SRH).
  • Tumor: Precision of 0.86 (SRS) / 0.92 (SRH) and Recall of 0.90 (SRS) / 0.82 (SRH).

The study also noted that the primary source of misclassification was between squamous epithelium and tumor, a challenge that persists even in traditional pathology.

Limitations and Future Work

The authors acknowledge several limitations:

  • Small Dataset Size: The study used a relatively small number of patients (8) and tiles for training, which could limit the generalizability of the model.
  • Rare Tumor Entities: The current model might not perform well on rare tumor subtypes, tumor precursors, or large inflammatory changes.
  • Need for Larger, Diverse Datasets: To enhance performance and robustness, larger and more diverse datasets are crucial.

Future work could involve:

  • Ensemble Learning: Combining predictions from multiple neural networks to improve stability and performance.
  • Developing a Global Database: Creating a publicly accessible, open-source database of scattering spectra for comparable histology.
  • Clinical Deployment: Investigating the trustworthiness and transparency of DL classifiers for effective clinical practice.
  • Expanding to Other Tissue Types: Training DL algorithms for tumor entities not included in this study.

Summary updated

Abstract

Stimulated Raman Histology (SRH) employs the stimulated Raman scattering (SRS) of photons at biomolecules in tissue samples to generate histological images. Subsequent pathological analysis allows for an intraoperative evaluation without the need for sectioning and staining. The objective of this study was to investigate a deep learning-based classification of oral squamous cell carcinoma (OSCC) and the sub-classification of non-malignant tissue types, as well as to compare the performances of the classifier between SRS and SRH images. Raman shifts were measured at wavenumbers k<sub>1</sub> = 2845 cm<sup>-1</sup> and k<sub>2</sub> = 2930 cm<sup>-1</sup>. SRS images were transformed into SRH images resembling traditional H&E-stained frozen sections. The annotation of 6 tissue types was performed on images obtained from 80 tissue samples from eight OSCC patients. A VGG19-based convolutional neural network was then trained on 64 SRS images (and corresponding SRH images) and tested on 16. A balanced accuracy of 0.90 (0.87 for SRH images) and F1-scores of 0.91 (0.91 for SRH) for stroma, 0.98 (0.96 for SRH) for adipose tissue, 0.90 (0.87 for SRH) for squamous epithelium, 0.92 (0.76 for SRH) for muscle, 0.87 (0.90 for SRH) for glandular tissue, and 0.88 (0.87 for SRH) for tumor were achieved. The results of this study demonstrate the suitability of deep learning for the intraoperative identification of tissue types directly on SRS and SRH images.
BibTeX
@inproceedings{weber2024ai,
  author = {Andreas Weber and Kathrin Enderle-Ammour and Konrad Kurowski and Marc Christian Metzger and Philipp Poxleitner and Martin Werner and René Rothweiler and Jürgen Beck and Jakob Straehle and Rainer Schmelzeisen and David Steybe and Peter Bronsert},
  title = {{AI-Based Detection of Oral Squamous Cell Carcinoma with Raman Histology}},
  booktitle = {Cancers},
  year = {2024},
  doi = {10.3390/cancers16040689},
}
Figure