Domain Invariant Model with Graph Convolutional Network for Mammogram Classification

Chu-ran Wang, Jing Li, Xinwei Sun, Fandong Zhang, Yizhou Yu, Yizhou WangarXiv 2022 · DOI · OpenReview

TL;DR

This paper introduces DIM-GCN, a novel framework for mammogram classification that tackles the critical challenge of out-of-distribution (OOD) generalization. By disentangling disease-relevant features from domain-specific biases using a Bayesian network and Graph Convolutional Networks, DIM-GCN achieves superior performance on unseen data, crucial for reliable medical diagnosis.

What Problem Does This Paper Address?

Medical image diagnosis, particularly for conditions like breast cancer detected via mammograms, demands high reliability. A significant hurdle is the variability in imaging and preprocessing techniques across different healthcare facilities. This "out-of-distribution" (OOD) data can cause traditional machine learning models to fail, as they often learn spurious correlations specific to the training data's domain. The goal is to build models that can generalize well to data from unseen hospitals or imaging systems, ensuring consistent diagnostic accuracy. The paper specifically addresses how to extract robust, disease-specific features that are invariant across these different data domains, overcoming the noise introduced by domain-dependent biases.

Methods

The core of the proposed solution is the Domain Invariant Model with Graph Convolutional Network (DIM-GCN). This framework is built upon a novel Bayesian network that explicitly models latent variables into three categories:

  • Macroscopic features (α): Clinically observable attributes like shape and margin.
  • Microscopic features (s): Subtle texture and pattern information.
  • Disease-irrelevant features (z): Domain-specific biases (e.g., from imaging or preprocessing).

The key innovation lies in the disentanglement of these latent variables. The authors propose a Variational Auto-Encoder (VAE) based objective function. The encoder is designed with two branches:

  1. Relevant Encoder: A domain-invariant encoder that learns the disease-related features (α and s).
  2. Irrelevant Encoder: A domain-specific encoder that learns the disease-irrelevant features (z). This encoder incorporates a Domain Adaptive Layer (DAL), which uses domain-specific batch normalization parameters to handle domain variations.

To further enhance the capture of macroscopic features, a Graph Convolutional Network (GCN) is employed to reconstruct the observed clinical attributes (A) from the macroscopic features (α). This leverages the inherent relationships between different attributes (e.g., shape and margin) to guide the learning process. Finally, the model is trained to predict the disease label (y) using only the disentangled disease-related features (s and α). A variance regularizer is also introduced to encourage the invariance of these disease-related features across domains.

Datasets

The authors evaluate their method on a combination of datasets:

  • Public Dataset: DDSM (Digital Database for Screening Mammography).
  • Three In-house Datasets: InH1, InH2, and InH3.

These datasets are collected from different hospitals, representing distinct domains. The experimental setup involves training on a combination of three datasets and testing on the remaining one to simulate OOD scenarios.

Key Insights and Ideas

  • Disentanglement is Key for OOD: The paper strongly advocates that disentangling disease-relevant features from domain-specific noise is crucial for achieving robust OOD generalization in medical imaging.
  • Medical Priors Matter: Incorporating domain knowledge, specifically the role of macroscopic and microscopic features in diagnosis, significantly improves model performance. The Bayesian network explicitly models these priors.
  • GCN for Attribute Correlation: Using GCNs to model the relationships between clinical attributes (like shape and margin) provides a powerful way to guide the learning of macroscopic features.
  • Domain Adaptive Layer for Bias Handling: The DAL in the irrelevant encoder is an effective mechanism for adapting to domain-specific variations without compromising the learning of invariant features.
  • Visualizing Disentanglement: The visualization results (Fig. 4) provide compelling evidence that the model successfully separates disease-related features (reconstructing lesion regions) from irrelevant features (capturing background anatomy and imaging artifacts).

Key Results

  • State-of-the-Art OOD Performance: DIM-GCN consistently outperforms existing methods in OOD mammogram classification, achieving AUC scores that are notably higher across various testing domains. For instance, in Table II, the proposed method achieves an AUC of 0.948 when testing on InH1, compared to the next best method's 0.889.
  • Significant Improvement: The paper reports an average improvement of 6.2% in AUC over other methods in OOD settings.
  • Effective Attribute Prediction: The model also demonstrates superior accuracy in predicting multi-attributes (mass shapes, mass margins) under OOD conditions, as shown in Table IX.

Limitations and Future Work

  • Computational Cost: While the DAL is more efficient than multiple encoders, the framework still involves complex disentanglement and GCN components, which can be computationally intensive.
  • Generalization to Other Modalities: The current work focuses on mammograms. The authors suggest that generalizing this method to other medical imaging problems, such as lung or liver cancer detection, would be a valuable future direction.
  • Further Exploration of Attributes: While GCNs are used to model attribute correlations, further research into more sophisticated ways to leverage these medical priors could yield even better results.

Summary updated

Abstract

Due to its safety-critical property, the image-based diagnosis is desired to achieve robustness on out-of-distribution (OOD) samples. A natural way towards this goal is capturing only clinically disease-related features, which is composed of macroscopic attributes (e.g., margins, shapes) and microscopic image-based features (e.g., textures) of lesion-related areas. However, such disease-related features are often interweaved with data-dependent (but disease irrelevant) biases during learning, disabling the OOD generalization. To resolve this problem, we propose a novel framework, namely Domain Invariant Model with Graph Convolutional Network (DIM-GCN), which only exploits invariant disease-related features from multiple domains. Specifically, we first propose a Bayesian network, which explicitly decomposes the latent variables into disease-related and other disease-irrelevant parts that are provable to be disentangled from each other. Guided by this, we reformulate the objective function based on Variational Auto-Encoder, in which the encoder in each domain has two branches: the domain-independent and -dependent ones, which respectively encode disease-related and -irrelevant features. To better capture the macroscopic features, we leverage the observed clinical attributes as a goal for reconstruction, via Graph Convolutional Network (GCN). Finally, we only implement the disease-related features for prediction. The effectiveness and utility of our method are demonstrated by the superior OOD generalization performance over others on mammogram benign/malignant diagnosis.
BibTeX
@misc{wang2022domain,
  author = {Chu-ran Wang and Jing Li and Xinwei Sun and Fandong Zhang and Yizhou Yu and Yizhou Wang},
  title = {{Domain Invariant Model with Graph Convolutional Network for Mammogram Classification}},
  year = {2022},
  eprint = {2204.09954},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2204.09954},
}
Figure