Using Deep Neural Network Approach for Multiple-Class Assessment of Digital Mammography

Shih‐Yen Hsu, Chi-Yuan Wang, Yi-Kai Kao, Kuo‐Ying Liu, Ming‐Chia Lin, Li-Ren Yeh, Yiming Wang, Chih‐I Chen, Feng‐Chen KaoHealthcare 2022 · DOI

TL;DR

This paper introduces a deep learning approach using a Fully Convolutional Dense Connection Network (FC-DCN) to classify mammography images into multiple categories based on BI-RADS reporting. The method achieves promising accuracy, sensitivity, and specificity, offering a potential tool to assist radiologists and improve the efficiency of breast cancer screening.

What Problem Does This Paper Address?

Mammography is a crucial tool for breast cancer detection, but its effectiveness can be hampered by operator technique, patient cooperation, and the subjective interpretation of images by physicians, leading to inconsistent identification of abnormalities. This variability can result in both missed diagnoses and unnecessary follow-ups. The paper aims to address this by developing an automated, objective classification system for mammography images.

Methods

The researchers employed a deep neural network approach, specifically a Fully Convolutional Dense Connection Network (FC-DCN), as the backbone for their mammography image classification model. The methodology involved several key steps:

  • Image Preprocessing: This included removing imaging markers and patient data, and applying a double-threshold method to eliminate noise and artifacts. A "fill hole" technology was used to address small gaps created by thresholding.
  • Data Augmentation: To expand the dataset and improve model robustness, techniques like rotation, horizontal flipping, and vertical flipping were applied.
  • Transfer Learning: The study utilized a pre-trained model as a starting point, leveraging transfer learning to adapt it for mammography classification. This involved modifying the input and output layers and fine-tuning the network weights.
  • FC-DCN Architecture: The FC-DCN architecture, known for its dense connections between layers, was chosen to facilitate feature reuse and mitigate gradient vanishing issues, allowing for deeper networks with fewer parameters.
  • Experimental Design: The study involved splitting the data into training and testing sets (7:3 and 5:5 ratios) and evaluating various batch sizes and iteration counts to find optimal parameters.

Datasets

The study utilized a retrospective dataset of mammography cases and their corresponding diagnostic reports. The images were collected from actual clinical cases between 2016 and 2017.

  • Dataset Size: The initial dataset comprised 150 cases, including 50 negative cases (BI-RADS-1) and 100 positive cases (BI-RADS-4 and BI-RADS-5).
  • Data Augmentation: Through data augmentation, the dataset was expanded to 5400 images.
  • Exclusions: Cases with BI-RADS-0, incomplete examinations, or those requiring additional images for interpretation were excluded. Cases of BI-RADS-6 (diagnosed with breast cancer and undergoing treatment) were also excluded to avoid potential disruption of feature extraction due to surgical intervention.

Key Insights and Ideas

  • FC-DCN for Mammography: The FC-DCN architecture proves effective for mammography classification, demonstrating that dense connections can lead to robust feature extraction and efficient learning, even with limited data.
  • Transfer Learning Benefits: Leveraging pre-trained models significantly reduces the time and computational resources required for developing a high-performing model, especially in domains with potentially smaller datasets like medical imaging.
  • Whole Image vs. ROI: The study's decision to use the entire mammography image for training, rather than just regions of interest (ROIs), provided richer feature information, potentially leading to better performance, albeit at the cost of increased training time.
  • Batch Size and Split Ratio Impact: The experimental results suggest that while batch size plays a role, the data split ratio (7:3 vs. 5:5) has a more significant impact on the model's overall performance.

Key Results

The study achieved the following performance metrics:

  • Best Accuracy: 86.37% (with a 7:3 training/testing split, batch size 30, and 50 iterations).
  • Best Sensitivity: 100% (achieved with the same parameters as the best accuracy).
  • Best Specificity: 72.73% (achieved with the same parameters as the best accuracy).
  • AUC: The best AUC achieved was 0.907 for the 7:3 split and 0.876 for the 5:5 split, indicating good discrimination capabilities.
  • General Performance: Even with a 5:5 data split, the model maintained nearly 80% accuracy, demonstrating its stability.

Limitations and Future Work

  • Limitations:
    • The study acknowledges that the deep learning algorithm falls under "weak AI," still requiring human intervention for parameter definition and training data annotation.
  • The research was conducted on a relatively small dataset, even after augmentation.
  • The whole image approach, while beneficial for feature extraction, leads to longer training times.
  • Future Work:
    • The authors suggest moving towards semi-automatic analysis methods, where the model performs initial classification, followed by expert secondary screening.
  • Developing more lightweight models is proposed to increase the feasibility of clinical application.
  • Further research into developing "strong AI" is envisioned for the future.

Summary updated

Abstract

According to the Health Promotion Administration in the Ministry of Health and Welfare statistics in Taiwan, over ten thousand women have breast cancer every year. Mammography is widely used to detect breast cancer. However, it is limited by the operator's technique, the cooperation of the subjects, and the subjective interpretation by the physician. It results in inconsistent identification. Therefore, this study explores the use of a deep neural network algorithm for the classification of mammography images. In the experimental design, a retrospective study was used to collect imaging data from actual clinical cases. The mammography images were collected and classified according to the breast image reporting and data-analyzing system (BI-RADS). In terms of model building, a fully convolutional dense connection network (FC-DCN) is used for the network backbone. All the images were obtained through image preprocessing, a data augmentation method, and transfer learning technology to build a mammography image classification model. The research results show the model's accuracy, sensitivity, and specificity were 86.37%, 100%, and 72.73%, respectively. Based on the FC-DCN model framework, it can effectively reduce the number of training parameters and successfully obtain a reasonable image classification model for mammography.
BibTeX
@inproceedings{hsu2022using,
  author = {Shih‐Yen Hsu and Chi-Yuan Wang and Yi-Kai Kao and Kuo‐Ying Liu and Ming‐Chia Lin and Li-Ren Yeh and Yiming Wang and Chih‐I Chen and Feng‐Chen Kao},
  title = {{Using Deep Neural Network Approach for Multiple-Class Assessment of Digital Mammography}},
  booktitle = {Healthcare},
  year = {2022},
  doi = {10.3390/healthcare10122382},
}
Figure