Artificial Intelligence-Powered Imaging Biomarker Based on Mammography for Breast Cancer Risk Prediction

Eun Kyung Park, Hyeonsoo Lee, Minjeong Kim, Taesoo Kim, Junha Kim, Kihwan Kim, Thijs Kooi, Yoosoo Chang, Seungho RyuDiagnostics 2024 · DOI

TL;DR

This paper introduces a novel Artificial Intelligence (AI) model, termed AI-IBM, that leverages mammographic images to predict future breast cancer risk. The AI-IBM demonstrates superior predictive performance compared to traditional clinical risk models and achieves comparable results to a state-of-the-art deep learning algorithm, offering a promising advancement in personalized breast cancer screening.

What Problem Does This Paper Address?

Current breast cancer screening relies heavily on mammography, which, while effective in reducing mortality, has limitations in sensitivity, particularly for women with dense breasts. Existing clinical risk prediction models, such as the Tyrer-Cuzick (TC) and Gail models, are based on factors like reproductive history, family history, and prior benign breast disease. However, these models often have suboptimal discriminatory power (AUC typically below 0.7) and may not fully capture the complex risk factors present in mammographic images. The challenge is to develop more accurate and robust methods for predicting future breast cancer risk, enabling better identification of high-risk individuals for targeted screening and preventative measures.

Methods

The researchers developed a deep learning AI algorithm, AI-IBM, based on a convolutional neural network (CNN) architecture, specifically using a pre-trained ResNet-34 as the image feature backbone. This network is designed to extract features from mammograms and generate an AI score indicating breast cancer risk over a 1-5 year horizon. The model was trained on serial mammographic examinations, incorporating ground-truth breast cancer information and examination time intervals. For comparison, the study also evaluated the performance of the Tyrer-Cuzick (TC) model, the Gail model, and a pre-existing deep learning algorithm called Mirai. Performance was assessed using C-indices and time-dependent Area Under the Receiver Operating Characteristic curves (AUCs).

Datasets

The study utilized two main datasets:

  • Development Dataset: Consisted of 36,995 serial mammographic examinations from 21,438 women, with a cancer-enriched proportion (17.5%) to facilitate effective training. This dataset was split into a training set (33,995 examinations) and a test set (3000 examinations) for internal model evaluation.
  • External Validation Dataset: A separate dataset of 16,894 mammograms from 6864 women was used for independent external validation. Of these, 4002 examinations were followed by a cancer diagnosis within 5 years. This dataset included mammograms from both Hologic and Siemens units, offering a more diverse evaluation compared to some existing models.

Key Insights and Ideas

  • Mammographic Patterns as Biomarkers: The study highlights that AI can go beyond simply detecting density and can identify subtle mammographic parenchymal patterns that are predictive of future cancer development, even in cases where visual discrimination by human eyes is difficult.
  • Contralateral Breast Information is Key: The AI model's ability to predict risk in one breast appears to be influenced by patterns in the contralateral breast, suggesting a systemic or shared risk factor captured by the imaging.
  • Cancer-Enriched Training is Beneficial: Using a cancer-enriched dataset for training the AI model, as opposed to a standard screening population, can lead to more effective learning of distinctive mammographic patterns associated with risk.
  • Time-Dependent Risk is Crucial: The AI model's ability to predict risk over a 1-5 year period, captured by time-dependent AUCs, is a significant improvement over static risk assessments.

Key Results

The AI-IBM model demonstrated strong predictive performance:

  • External Validation: Achieved a C-index of 0.76 and time-dependent AUCs for 1-5 year risk prediction ranging from 0.78 to 0.90.
  • Comparison to Clinical Models: The AI-IBM's 5-year AUC (0.81) was significantly higher than the TC model (0.57) and the Gail model (0.52) (p < 0.001 for both).
  • Comparison to Mirai: The AI-IBM achieved similar performance to Mirai, another advanced deep learning model, with a statistically significant higher AUC for 3-year prediction (p = 0.019).
  • Test Set Performance: In the development test set, the AI model showed AUCs ranging from 0.72 to 0.87 for 1-5 year predictions.

Limitations and Future Work

The authors acknowledge several limitations:

  • Retrospective Data: The study used retrospectively collected data with diverse examination time intervals, which may not perfectly reflect real-world screening programs.
  • Unclear Implementation in Practice: It remains unclear how to best integrate AI prediction models into existing clinical workflows and guidelines.
  • Exclusion of Certain Factors: Breast density and specific breast cancer characteristics were not explicitly incorporated into the model's evaluation, although they are known risk factors.
  • Calibration Not Evaluated: While discrimination performance was robust, calibration (how well the predicted probabilities match actual outcomes) was not evaluated and is suggested for future work.

Future research directions include:

  • Calibration Evaluation: Assessing the model's calibration to ensure accurate probability estimates.
  • Incorporating More Features: Investigating the impact of additional clinical and imaging features (e.g., breast density, prior imaging) to further enhance model robustness.
  • Prospective Studies: Conducting prospective studies to validate the AI model in real-world screening settings.
  • Personalized Screening: Exploring how this AI model can be used to personalize breast cancer screening strategies, particularly for high-risk individuals.

Summary updated

Abstract

The purposes of this study were to develop an artificial intelligence (AI) model for future breast cancer risk prediction based on mammographic images, investigate the feasibility of the AI model, and compare the AI model, clinical statistical risk models, and Mirai, a state of-the art deep learning algorithm based on screening mammograms for 1-5-year breast cancer risk prediction. We trained and developed a deep learning model using a total of 36,995 serial mammographic examinations from 21,438 women (cancer-enriched mammograms, 17.5%). To determine the feasibility of the AI prediction model, mammograms and detailed clinical information were collected. C-indices and area under the receiver operating characteristic curves (AUCs) for 1-5-year outcomes were obtained. We compared the AUCs of our AI prediction model, Mirai, and clinical statistical risk models, including the Tyrer-Cuzick (TC) model and Gail model, using DeLong's test. A total of 16,894 mammograms were independently collected for external validation, of which 4002 were followed by a cancer diagnosis within 5 years. Our AI prediction model obtained a C-index of 0.76, with AUCs of 0.90, 0.84, 0.81, 0.78, and 0.81, to predict the 1-5-year risks. Our AI prediction model showed significantly higher AUCs than those of the TC model (AUC: 0.57; <i>p</i> < 0.001) and Gail model (AUC: 0.52; <i>p</i> < 0.001), and achieved similar performance to Mirai. The deep learning AI model using mammograms and AI-powered imaging biomarkers has substantial potential to advance accurate breast cancer risk prediction.
BibTeX
@inproceedings{park2024artificial,
  author = {Eun Kyung Park and Hyeonsoo Lee and Minjeong Kim and Taesoo Kim and Junha Kim and Kihwan Kim and Thijs Kooi and Yoosoo Chang and Seungho Ryu},
  title = {{Artificial Intelligence-Powered Imaging Biomarker Based on Mammography for Breast Cancer Risk Prediction}},
  booktitle = {Diagnostics},
  year = {2024},
  doi = {10.3390/diagnostics14121212},
}
Figure