Coronary calcium detection using 3D attention identical dual deep network based on weakly supervised learning

Yuankai Huo, James G. Terry, Jiachen Wang, Vishwesh Nath, Camilo Bermudez, Shunxing Bao, Prasanna Parvathaneni, John Jeffrey Carr, Bennett A. Landman

TL;DR

This paper introduces AID-Net, a novel 3D deep learning model for detecting coronary artery calcium (CAC) using weakly supervised learning. By leveraging scan-rescan pairs and incorporating 3D attention mechanisms, AID-Net achieves high accuracy in identifying CAC without requiring laborious, slice-wise manual annotations, making large-scale CAC screening more feasible.

What Problem Does This Paper Address?

Coronary artery calcium (CAC) is a critical indicator of subclinical coronary artery disease and a strong predictor of future heart attacks and cardiovascular death. The current gold standard for CAC detection involves manual delineation of calcified lesions on CT scans, a process that is time-consuming, resource-intensive, and impractical for analyzing large patient cohorts. This bottleneck hinders widespread screening and early intervention. While deep learning has shown promise in medical image analysis, existing methods often require detailed, voxel-level annotations, which are equally burdensome to obtain. This paper aims to bridge this gap by developing an automated CAC detection method that relies on weaker supervision (scan-level labels) and can be applied to large datasets.

Methods

The core of the proposed solution is the Attention Identical Dual Network (AID-Net). This is a 3D Convolutional Neural Network (CNN) designed to process longitudinal CT scans (scan-rescan pairs). The "identical dual" aspect refers to the network's architecture, which processes both the "scan" and "rescan" inputs through identical pathways, inspired by Siamese networks. This allows the model to learn from the consistency and differences between repeated scans of the same patient.

Key novelties include:

  • Weakly Supervised Attention: AID-Net uses only per-subject level labels (i.e., whether CAC is present or not in a scan) for training. To enhance performance and interpretability, it integrates 3D attention mechanisms.
  • 3D Soft Attention Gate (SAG): A 3D extension of a 2D attention mechanism is incorporated during training. This attention gate helps the network focus on relevant local features from higher-level layers, providing complementary information to the global features extracted by the network.
  • 3D Gradient-weighted Class Activation Mapping (Grad-CAM): For interpretability, the authors extend the Grad-CAM technique to 3D. This allows visualization of which regions in the CT scan the network is attending to when making a classification decision, effectively localizing potential CAC.
  • Dual-Channel Input: The network takes two channels as input: the preprocessed CT scan and a binary mask highlighting voxels with HU scores above 130 (a common threshold for calcification).

The total loss function for AID-Net comprises cross-entropy losses for each path and a contrastive loss term that encourages similarity between the outputs of the two paths when inputs are similar and dissimilarity when they are different.

Datasets

The study utilized a dataset of 5075 non-contrast chest CT scans. These scans were used for training, validation, and testing. The paper mentions that these scans were obtained with available Agatston calcium scores, which are used to categorize the severity of CAC. The dataset was split into training (1107 control scans, 848 scans with Agatston score < 400, 377 scans with Agatston score ≥ 400), validation (205 scans), and independent testing (206 scans) sets.

Key Insights and Ideas

  • Leveraging Scan-Rescan Data: Using scan-rescan pairs for training is a powerful strategy for weakly supervised learning. The inherent redundancy and subtle changes between scans provide rich supervisory signals without explicit voxel-level annotations.
  • 3D Attention for Medical Imaging: Extending attention mechanisms to 3D is crucial for volumetric medical data. The 3D SAG effectively guides the network to focus on diagnostically relevant regions, improving classification accuracy.
  • Interpretability is Key: The application of 3D Grad-CAM is a significant contribution, as it provides visual explanations for the network's decisions. This is vital for clinical adoption, allowing clinicians to understand why a diagnosis is made and to trust the AI's output. The visualization also shows that the attention mechanism can roughly localize CAC.
  • Weak Supervision is Sufficient: The success of AID-Net demonstrates that high performance can be achieved for CAC detection even with only scan-level labels, significantly reducing the annotation burden compared to previous methods.

Key Results

The proposed AID-Net achieved state-of-the-art performance on the CAC detection task:

  • Classification Accuracy: 0.9272
  • Area Under the ROC Curve (AUC): 0.9627

These results were superior to baseline methods like 3D ResNet and 3D DenseNet, as well as an ID-Net variant without the training attention mechanism. The paper also explored two classification strategies: a simple presence/absence of CAC and a three-class approach (control, low CAC, high CAC), with the latter yielding better performance.

Limitations and Future Work

  • Qualitative Attention Validation: The authors acknowledge that the attention mechanisms were presented as qualitative results without quantitative validation due to the lack of per-voxel/lesion annotations.
  • Future Work:
    • Quantitative Validation: The authors plan to validate the attention model using per-voxel/lesion annotations in future work, which they believe will further improve performance.
  • Integration with Segmentation: They suggest that combining CAC detection with detailed 3D medical image segmentation techniques for heart structures could lead to even better results, potentially through multi-task learning.
  • Larger Clinical Cohorts: The weakly supervised nature of AID-Net makes it suitable for training on larger clinical cohorts where only Agatston scores are available.

Summary updated

Abstract

Coronary artery calcium (CAC) is biomarker of advanced subclinical coronary artery disease and predicts myocardial infarction and death prior to age 60 years. The slice-wise manual delineation has been regarded as the gold standard of coronary calcium detection. However, manual efforts are time and resource consuming and even impracticable to be applied on large-scale cohorts. In this paper, we propose the attention identical dual network (AID-Net) to perform CAC detection using scan-rescan longitudinal non-contrast CT scans with weakly supervised attention by only using per scan level labels. To leverage the performance, 3D attention mechanisms were integrated into the AID-Net to provide complementary information for classification tasks. Moreover, the 3D Gradient-weighted Class Activation Mapping (Grad-CAM) was also proposed at the testing stage to interpret the behaviors of the deep neural network. 5075 non-contrast chest CT scans were used as training, validation and testing datasets. Baseline performance was assessed on the same cohort. From the results, the proposed AID-Net achieved the superior performance on classification accuracy (0.9272) and AUC (0.9627).
BibTeX
@inproceedings{huo2019coronary,
  author = {Yuankai Huo and James G. Terry and Jiachen Wang and Vishwesh Nath and Camilo Bermudez and Shunxing Bao and Prasanna Parvathaneni and John Jeffrey Carr and Bennett A. Landman},
  title = {{Coronary calcium detection using 3D attention identical dual deep network based on weakly supervised learning}},
  booktitle = {Image Processing},
  year = {2019},
  doi = {10.1117/12.2512541},
}
Figure