Enhancing physician support in pancreatic cancer diagnosis: New M-F-RCNN artificial intelligence model using endoscopic ultrasound

Shanshan Hu, Bowen Duan, Li Xu, Y. Huang, Xiaogang Liu, Shihao Gou, Xiaochen Zhao, Jie Hou, Shirong Tan, Lan He, Ying Ye, Xiaoli Xie, Hong Shen, Wei LiuEndoscopy 2024 · DOI

This research paper, recently published in Endoscopy International Open, introduces a specialized deep-learning model designed to tackle one of the most challenging tasks in oncology: the early detection of pancreatic cancer.

TL;DR

Researchers developed M-F-RCNN, a modified Faster R-CNN model that utilizes multi-scale feature fusion and receptive field blocks to identify pancreatic cancer in endoscopic ultrasound (EUS) images. The model achieves over 91% accuracy in external validation and significantly boosts the diagnostic performance of less-experienced physicians, bringing their accuracy close to that of experts.

What Problem Does This Paper Address?

Pancreatic cancer is notoriously lethal, often diagnosed only after it has metastasized. While Endoscopic Ultrasound (EUS) provides high-resolution images of the pancreas, interpreting these images is difficult. The "signal-to-noise" ratio is low due to ultrasound artifacts, and diagnostic accuracy depends heavily on the physician's experience.

There is a significant "performance gap" between expert endoscopists and novices. The authors sought to bridge this gap by creating an AI assistant that can provide real-time, high-accuracy diagnostic support, reducing human error and improving early detection rates.

Methods

The authors built upon the Faster R-CNN (Region-based Convolutional Neural Network) framework, introducing several "Modified" (M) and "Fusion" (F) enhancements:

  • Backbone Upgrade: They replaced standard backbones with ResNet-50 to better extract deep features.
  • Feature Fusion Module (FFM): This allows the model to combine low-level structural details with high-level semantic information, which is crucial for identifying the subtle borders of pancreatic lesions.
  • ROI Align: Unlike older ROI Pooling, ROI Align uses bilinear interpolation to handle floating-point coordinates, preventing the "misalignment" of small features.
  • Receptive Field Block (RFB): This module mimics the human visual system's ability to emphasize the center of a field of view while considering the periphery, helping the model focus on relevant textures in noisy ultrasound data.
  • Preprocessing Pipeline: The team used CLAHE (Contrast-Limited Adaptive Histogram Equalization) and bilateral filtering to denoise images and enhance contrast before feeding them into the neural network.

Datasets

The study utilized two primary datasets:

  • Dataset A (Internal): 1,800 EUS images (including 1,500 augmented cancerous images and 300 non-cancerous images) from 155 patients across three centers. This was used for training and initial testing.
  • Dataset B (External Validation): 1,000 randomly selected EUS images (585 cancerous, 415 non-cancerous) to test the model’s generalizability on "unseen" data.
  • Human Benchmark: A subset was used for a "human-computer competition" involving two expert and three novice endoscopists.

Key Insights and Ideas

  • The "Novice Boost": The most striking insight isn't just that the AI is accurate, but how it functions as a "force multiplier." Novice physicians saw their Area Under the Curve (AUC) jump from as low as 0.594 to over 0.910 when assisted by the AI.
  • Real-Time Feasibility: The model processes images in approximately 98ms, well within the threshold for real-time video assistance during a live procedure.
  • Overcoming Ultrasound Noise: By integrating RFB and FFM, the researchers addressed the specific "messiness" of ultrasound images (low contrast and speckle noise) that often trips up standard computer vision models designed for crisp photographic data.

Key Results

  • Internal Performance: The M-F-RCNN achieved an Average Precision (AP) of 97.35% and a recall of 98.72%, significantly outperforming standard models like SSD and Yolo-v5.
  • External Validation: On the 1,000-image external set, the model maintained a sensitivity of 91.7% and specificity of 91.5%.
  • Human vs. AI: In head-to-head tests, the AI outperformed novices and matched or slightly exceeded the performance of experts. More importantly, when physicians used the AI as a "second pair of eyes," the diagnostic gap between novices and experts virtually disappeared.

Limitations and Future Work

Despite the impressive numbers, the authors acknowledge several hurdles:

  • Dataset Diversity: The training set was relatively small (155 patients). While data augmentation helped, larger and more diverse datasets are needed to handle rare pancreatic variants.
  • Differential Diagnosis: Distinguishing between pancreatic cancer and chronic pancreatitis remains a "hard problem" for both humans and AI; the authors plan to focus future iterations on this specific distinction.
  • From Stills to Video: This study focused on static images. The next logical step is prospective video validation, where the AI must maintain accuracy across a continuous stream of moving ultrasound frames.

Reference: Hu Shan-shan, et al. "Enhancing physician support in pancreatic cancer diagnosis: New M-F-RCNN artificial intelligence model using endoscopic ultrasound." Endosc Int Open 2024; 12: E1277–E1284. DOI: 10.1055/a-2422-9214.

Summary updated

Abstract

<b>Background and study aims</b> Endoscopic ultrasound (EUS) is vital for early pancreatic cancer diagnosis. Advances in artificial intelligence (AI), especially deep learning, have improved medical image analysis. We developed and validated the Modified Faster R-CNN (M-F-RCNN), an AI algorithm using EUS images to assist in diagnosing pancreatic cancer. <b>Methods</b> We collected EUS images from 155 patients across three endoscopy centers from July 2022 to July 2023. M-F-RCNN development involved enhancing feature information through data preprocessing and utilizing an improved Faster R-CNN model to identify cancerous regions. Its diagnostic capabilities were validated against an external set of 1,000 EUS images. In addition, five EUS doctors participated in a study comparing the M-F-RCNN model's performance with that of human experts, assessing diagnostic skill improvements with AI assistance. <b>Results</b> Internally, the M-F-RCNN model surpassed traditional algorithms with an average precision of 97.35%, accuracy of 96.49%, and recall rate of 5.44%. In external validation, its sensitivity, specificity, and accuracy were 91.7%, 91.5%, and 91.6%, respectively, outperforming non-expert physicians. The model also significantly enhanced the diagnostic skills of doctors. <b>Conclusions:</b> The M-F-RCNN model shows exceptional performance in diagnosing pancreatic cancer via EUS images, greatly improving diagnostic accuracy and efficiency, thus enhancing physician proficiency and reducing diagnostic errors.
BibTeX
@inproceedings{hu2024enhancing,
  author = {Shanshan Hu and Bowen Duan and Li Xu and Y. Huang and Xiaogang Liu and Shihao Gou and Xiaochen Zhao and Jie Hou and Shirong Tan and Lan He and Ying Ye and Xiaoli Xie and Hong Shen and Wei Liu},
  title = {{Enhancing physician support in pancreatic cancer diagnosis: New M-F-RCNN artificial intelligence model using endoscopic ultrasound}},
  booktitle = {Endoscopy},
  year = {2024},
  doi = {10.1055/a-2422-9214},
}
Figure