Domain Adaptation for Deviating Acquisition Protocols in CNN-based Lesion Classification on Diffusion-Weighted MR Images

Jennifer Kamphenkel, Paul F. Jaeger, Sebastian Bickelhaupt, Frederik Bernd Laun, Wolfgang Lederer, Heidi Daniel, Tristan Anselm Kuder, Stefan Delorme, Heinz-Peter Schlemmer, Franziska Koenig, Klaus H. Maier-Hein

This paper, presented at a medical imaging conference, addresses a major hurdle in deploying deep learning for clinical radiology: the lack of standardization in how images are acquired.

TL;DR

The authors propose Model-based Domain Adaptation (MBDA), a technique that uses physical diffusion models to "translate" MRI data from different clinical protocols into a format a pre-trained neural network understands. This approach significantly boosts breast cancer classification accuracy without requiring clinical sites to retrain models or change their scanning hardware.

What Problem Does This Paper Address?

Convolutional Neural Networks (CNNs) have shown great promise in classifying breast lesions using Diffusion-Weighted Imaging (DWI). However, CNNs are notoriously brittle; they typically expect input data to look exactly like the data they were trained on.

In the real world, MRI protocols vary significantly between hospitals. Specifically, the "b-values" (which control the sensitivity to water diffusion) are rarely standardized. If a model is trained on images with b-values of 0, 100, 750, and 1500, but a new hospital provides images at b=0, 50, and 800, the model’s performance usually plummets. Retraining a model for every hospital is impractical due to the scarcity of labeled medical data. The authors sought a way to make these models "protocol-agnostic."

Methods

The researchers compared three main approaches to handle protocol deviations:

  1. End-to-End (E2E): The standard approach where raw DWI images are fed directly into a CNN. This is highly accurate but very sensitive to protocol changes.
  2. Fit-to-End (F2E): An "implicit" adaptation method. Instead of raw images, the CNN is trained on physical parameters (like the Apparent Diffusion Coefficient, ADC) derived from a Diffusion Kurtosis Imaging (DKI) model. Because these parameters are physical properties of the tissue, they should theoretically be protocol-independent.
  3. Model-based Domain Adaptation (MBDA - The Proposal): This is a hybrid approach. During testing, if the input b-values don't match the training set, the authors fit a DKI model to the available data. They then use that model to synthesize the missing or shifted b-value images that the CNN expects.
Fig. 2: Concept of our proposed method for the missing scenario (top). The missing b-value is derived from a DKI-model and used as CNN input. The fit- to-end architecture trained on ADC and AKC is used for comparison (bottom).

The core idea is to use the physics of diffusion as a bridge, allowing the CNN to continue "exploiting" raw signal correlations it learned during training, even when the input data is altered.

Datasets

The study utilized a dataset of 221 patients who had undergone mammography screenings and were subsequently referred for MRI and biopsy.

  • Ground Truth: 121 malignant and 100 benign lesions, confirmed via core-needle biopsy.
  • Imaging: 1.5 T MR scanners providing four b-values (0, 100, 750, 1500 s/mm²).
  • Preprocessing: Lesions were manually segmented by expert radiologists to create regions of interest (ROIs).

Key Insights and Ideas

  • Physics as a Normalizer: Rather than trying to make the neural network learn protocol invariance (which is hard), the authors use a well-understood physical model (DKI) to normalize the data before it hits the network.
  • Raw Signal vs. Parameters: The authors found that CNNs trained on raw signal (E2E) outperform those trained on summary physical parameters (F2E). This suggests that CNNs pick up on subtle correlations in the raw data that are lost during the curve-fitting process of standard modeling.
  • "Minimal Invasive" Adaptation: MBDA is elegant because it doesn't require changing the training phase. You can take a high-performing E2E model and simply add the DKI-based restoration step at the deployment site.

Key Results

The authors tested two scenarios: shifted b-values and missing b-values.

  • Performance Recovery: Without adaptation, E2E models saw performance drops of up to 19.2%. MBDA was able to significantly recover this, showing an average increase in AUC (Area Under the Curve) of 12.4% in shifted scenarios and 16.8% in missing scenarios.
  • Superiority over F2E: MBDA consistently outperformed the "Fit-to-End" approach. In the missing scenario, MBDA outperformed F2E by 12.4%.
  • Redundancy: Interestingly, the results showed that subsets of three b-values often contain nearly as much information as the full set of four, provided the model is adapted correctly.
Fig. 3: Mean AUC derived from Table 1. Matched input represents the upper bound with matching b-value subsets during training and inference. Altered In- put represents the lower bound by testing on the altered subset without domain adaptation. E2E with MBDA significantly improves the robustness towards het- erogeneous inputs compared to F2E with altered inputs (implicit domain adap- tation) in both scenarios.

Limitations and Future Work

  • Extrapolation Issues: The method struggles when it has to "guess" signal at very high b-values that are far beyond the provided data, as this is a poorly constrained mathematical problem.
  • Single Alterations: The study primarily looked at cases where one b-value was missing or shifted. Future work needs to address more complex scenarios with multiple protocol deviations.
  • Segmentation Dependency: The current pipeline relies on manual lesion segmentation. Moving toward a fully automated system that works on unsegmented whole-breast images is a logical next step.

Summary updated

Abstract

End-to-end deep learning improves breast cancer classification on diffusion-weighted MR images (DWI) using a convolutional neural network (CNN) architecture. A limitation of CNN as opposed to previous model-based approaches is the dependence on specific DWI input channels used during training. However, in the context of large-scale application, methods agnostic towards heterogeneous inputs are desirable, due to the high deviation of scanning protocols between clinical sites. We propose model-based domain adaptation to overcome input dependencies and avoid re-training of networks at clinical sites by restoring training inputs from altered input channels given during deployment. We demonstrate the method's significant increase in classification performance and superiority over implicit domain adaptation provided by training-schemes operating on model-parameters instead of raw DWI images.
BibTeX
@inproceedings{kamphenkel2018domain,
  author = {Jennifer Kamphenkel and Paul F. Jaeger and Sebastian Bickelhaupt and Frederik Bernd Laun and Wolfgang Lederer and Heidi Daniel and Tristan Anselm Kuder and Stefan Delorme and Heinz-Peter Schlemmer and Franziska Koenig and Klaus H. Maier-Hein},
  title = {{Domain Adaptation for Deviating Acquisition Protocols in CNN-based Lesion Classification on Diffusion-Weighted MR Images}},
  booktitle = {RAMBO+BIA+TIA @ MICCAI},
  year = {2018},
  doi = {10.1007/978-3-030-00946-5\_8},
}
Figure