Discrimination of Breast Cancer Based on Ultrasound Images and Convolutional Neural Network

Rui Du, Yanwei Chen, Tao Li, Liang Shi, Zheng-Dong Fei, Yuefeng LiJournal of Oncology 2022 · DOI

TL;DR

This paper introduces an AI tool, Efficient-Det, for diagnosing breast cancer from ultrasound images. It achieves competitive accuracy with expert radiologists while being significantly faster, offering a promising solution to the growing burden of breast cancer screening.

What Problem Does This Paper Address?

Breast cancer is a leading cause of death for women, and early detection is crucial. Ultrasound (US) is a cost-effective and fast screening tool, but the sheer volume of images generated daily overwhelms clinical radiologists. This leads to increased workload, potential for errors due to radiologist inconsistency, and delayed diagnoses. While computer-aided diagnosis (CAD) systems exist, traditional methods involve a two-step process of segmentation and feature extraction, which can be time-consuming and complex. The paper aims to develop a more efficient, one-stage AI system that can both locate suspicious lesions and classify them as benign, malignant, or normal, addressing the need for faster, more accurate, and less labor-intensive breast cancer diagnosis.

Methods

The core of this research is the adaptation and application of the Efficient-Det deep learning model for breast cancer classification. Efficient-Det is a one-stage object detection architecture known for its efficiency and performance. The authors employed transfer learning, initializing Efficient-Det with parameters pre-trained on a large general image dataset (COCO). This pre-trained model was then fine-tuned on breast ultrasound images.

Key methodological aspects include:

  • Data Augmentation: Techniques like shearing, rescaling, and flipping were used to increase the diversity of the training data.
  • Training Strategies: Standard deep learning practices such as early stopping, learning rate decay, and freeze fine-tuning were utilized to optimize the training process.
  • Loss Function: A combined loss function, comprising smooth_L1 (for box regression) and Focal Loss (to address class imbalance), was used.
  • Comparison Methods: The Efficient-Det model was compared against:
  • Expert Radiologist Diagnosis: Based on manual review of images.
  • Feature Engineering (FE) + Support Vector Machine (SVM): A traditional CAD approach involving manual cropping of regions of interest (ROIs), extraction of morphological and texture features, and classification using an SVM.

Datasets

The study utilized a combination of datasets:

  • Local Hospital Dataset: Images from 487 female patients who underwent breast ultrasound examination at the Affiliated Hospital of Jiangsu University between June 2015 and June 2020. This dataset, after exclusions, comprised 1181 images (558 benign, 370 malignant, 253 normal).
  • Publicly Accessible Dataset: 694 images from Kaggle (specifically, the "datasetbusiwithgt" dataset) were used for initial model training. This dataset contained 379 benign, 182 malignant, and 133 normal tissue images.

A subset of 150 images (50 benign, 50 malignant, 50 normal) from the local hospital dataset was set aside as an independent test set for evaluating the Efficient-Det model's performance on unseen data. This same test set was also used for evaluating the expert and FE-SVM methods.

Key Insights and Ideas

  • One-Stage Detection for Efficiency: The use of Efficient-Det, a one-stage detector, is crucial. It simultaneously performs localization and classification, eliminating the need for separate segmentation steps common in traditional CAD systems, leading to significant speed improvements.
  • Transfer Learning's Power: Leveraging pre-trained models via transfer learning significantly reduces the need for massive, task-specific datasets and accelerates the development of effective AI models for medical imaging.
  • Balancing Accuracy and Speed: While expert radiologists achieve the highest accuracy, their time cost per image is prohibitive for large-scale screening. Efficient-Det offers a compelling trade-off, providing competitive accuracy at an exceptionally fast inference speed.
  • Interpreting the "Black Box": The paper acknowledges the "black box" nature of deep learning models. The use of Grad-Cam visualization provides valuable insights into where the model is looking to make its predictions, highlighting the importance of tumor center regions for classification.
  • Clinical Applicability: The study demonstrates that Efficient-Det can be effectively deployed in real clinical workflows, suggesting its potential to augment, rather than replace, human expertise.

Key Results

  • Accuracy:
    • Expert Diagnosis: 95.3% mean accuracy.
  • Efficient-Det: 92.6% mean accuracy.
  • FE + SVM: 90% mean accuracy.
  • Speed:
    • Expert Diagnosis: 60 seconds per image.
  • Efficient-Det: 0.06 seconds per image.
  • FE + SVM: 15 seconds per image.
  • Classification Performance: Efficient-Det showed slightly lower accuracy in identifying benign lesions (96% vs. 100% for FE-SVM, 98% for expert) but was more accurate in identifying malignant lesions (90% vs. 80% for FE-SVM, 98% for expert).
  • False Positives: The paper discusses specific false-positive cases, illustrating scenarios where the model or experts encountered ambiguous images. Grad-Cam visualization helped identify why Efficient-Det might classify an image as "normal" when no suspicious regions were detected.

Limitations and Future Work

  • Dataset Size and Diversity: While the study combined local and public datasets, the authors acknowledge that more diverse and larger datasets are needed to further improve the model's robustness against false-positive cases and enhance its overall diagnostic precision.
  • Interpretability: Despite using Grad-Cam, deep learning models remain largely "black boxes." While Grad-Cam provides visual explanations, the inherent complexity of CNNs makes full decomposability challenging.
  • Clinical Workflow Integration: The optimal integration of AI tools like Efficient-Det into existing clinical workflows requires further investigation.
  • Future Directions: The authors suggest that fine-tuning Efficient-Det with increasing local data could build a stronger baseline. They also emphasize the need for intelligent and "tiny" AI algorithms suitable for cloud deployment and the potential for developing early-stage detection models by analyzing more distinctive parameters.

Summary updated

Abstract

The aim of our study was to establish an artificial intelligence tool for the diagnosis of breast disease base on ultrasound (US) images. A deep learning algorithm Efficient-Det assisted US diagnosis method was developed to determine breast suspicious lesions as benign, malignant, or normal. Totally 1181 US images from 487 patients of our hospital and 694 publicly accessible images were employed for modeling, including 558 benign images, 370 malignant images, and 253 normal tissue images. The actual diagnosis results for the patients were determined by the biopsy or surgery. Efficient-Det was first retrained using an exclusive public breast cancer US dataset with transfer learning techniques. A blind test set consisting of 50 benign, 50 malignant, and 50 normal tissue images was randomly picked from the patients' images as the independent test set to test its searching ability on suspicious tumor regions. Furthermore, the confusion matrix and classification accuracy were employed as evaluation metrics to select the optimal classification models. Efficient-Det has demonstrated remarkable progress in general image recognition tasks with specific advantages of locating and identifying tumor areas simultaneously. Compared to the manual method (mean accuracy: 95.3% and 60 s per image) and traditional feature engineering method (mean accuracy: 90% and 15 s per image), our Efficient-Det has the capability of providing a competitive (mean accuracy: 92.6%) and fast (0.06 s per image) classification result. The deployment of Efficient-Det in our local breast cancer discrimination task exhibits specific applicability within real clinical workflows.
BibTeX
@article{du2022discrimination,
  author = {Rui Du and Yanwei Chen and Tao Li and Liang Shi and Zheng-Dong Fei and Yuefeng Li},
  title = {{Discrimination of Breast Cancer Based on Ultrasound Images and Convolutional Neural Network}},
  journal = {Journal of Oncology},
  year = {2022},
  doi = {10.1155/2022/7733583},
}
Figure