Maximum Classifier Discrepancy Generative Adversarial Network for Jointly Harmonizing Scanner Effects and Improving Reproducibility of Downstream Tasks

Weizheng Yan, Zening Fu, Rongtao Jiang, Jing Sui, Vince D. CalhounbioRxiv 2022 · DOI

TL;DR

This paper introduces MCD-GAN, a novel framework that harmonizes MRI data from different scanners while simultaneously improving performance on downstream tasks like classification. By integrating domain adaptation techniques with generative adversarial networks, MCD-GAN effectively removes scanner-specific biases without sacrificing crucial anatomical information, leading to more reproducible research.

What Problem Does This Paper Address?

Multi-site collaborations are crucial for overcoming sample size limitations in medical research, particularly in neuroimaging. However, data collected from different MRI scanners often exhibit significant variations (scanner effects) that reduce the reliability and reproducibility of findings. Existing methods for harmonizing this data either struggle to guarantee improved performance on subsequent tasks or can alter the underlying anatomical structure of the images. This gap hinders the ability to confidently apply models or biomarkers discovered at one site to data from another, limiting the impact of large-scale studies.

Methods

The core innovation of this paper is the MCD-GAN framework, which combines two key ideas:

  • CycleGAN for Harmonization: It leverages the CycleGAN architecture, which uses two generators and two discriminators, to learn mappings between different scanner domains. This allows it to translate data from one scanner's format to another's while preserving the structural layout of the original images. This is crucial for medical imaging where anatomical integrity is paramount.
  • Maximum Classifier Discrepancy (MCD) for Task Integration: MCD is incorporated to ensure that the harmonization process actively improves downstream task performance. MCD works by training two classifiers on the source domain and then using their differing predictions on generated target domain samples to guide the generator. This forces the generator to produce harmonized data that is not only consistent across scanners but also more discriminative for the specific task (e.g., classification).

The training process involves several steps: pre-training the generators and discriminators, training the classifiers to maximize discrepancy while maintaining source domain performance, and finally optimizing the generator to minimize this discrepancy.

Datasets

The MCD-GAN was evaluated on:

  • Simulated Data ("double moon"): A synthetic dataset designed to mimic domain shift and non-linear confounds. Domain 2 was created by rotating Domain 1.
  • Adolescent Brain Cognitive Development (ABCD) Dataset: This large-scale, longitudinal study provided real-world neuroimaging data. Specifically, the researchers used:
  • Cortical Thickness Features: 68 features representing cortical thickness from MRI scans.
  • T1-weighted MRI Images: Raw 3D MRI scans.

The ABCD data was collected using scanners from GE and SIEMENS manufacturers, serving as the basis for evaluating cross-scanner harmonization.

Key Insights and Ideas

  • Harmonization with a Purpose: The most significant insight is that harmonizing data solely for visual consistency or distribution matching isn't enough. Actively incorporating the downstream task into the harmonization process is key to guaranteeing improved performance.
  • Preserving Anatomy Matters: Unlike some domain adaptation methods that might distort anatomical information, MCD-GAN's use of CycleGAN ensures that the structural integrity of the MRI data is maintained, which is critical for clinical interpretation.
  • GANs for Continuous Harmonization: GAN-based approaches like MCD-GAN are more flexible for continuous harmonization. They map target domain samples to a source domain, meaning new scanners can be added by training a new mapping model without retraining on all existing data, unlike methods like ComBat.
  • The Trade-off of Discrepancy: The paper highlights that while maximizing classifier discrepancy is beneficial, there's an optimal point. Too much emphasis on discrepancy can lead to performance degradation, suggesting a careful tuning of hyperparameters.

Key Results

  • Superior Classification Performance: MCD-GAN consistently outperformed state-of-the-art methods like ComBat and CycleGAN in cross-scanner classification accuracy across simulated and real-world ABCD datasets. For example, on the "double moon" test set, MCD-GAN achieved 97.5% accuracy compared to 83.0% for CycleGAN and 75.2% for ComBat.
  • Preservation of Anatomical Layout: Visualizations confirmed that MCD-GAN successfully removed scanner effects while preserving the anatomical structure of the images, as demonstrated by tSNE plots of cortical thickness features.
  • Robustness to Non-linear Confounds: MCD-GAN showed better performance in harmonizing data with non-linear confounds compared to ComBat, which struggled with such effects.

Limitations and Future Work

  • Computational Complexity: Harmonizing data from K scanners requires training K-1 models. The authors suggest exploring ways to balance computational complexity with performance as K increases.
  • Beyond Scanner Effects: The current work focuses on scanner effects. Future work should investigate harmonizing other confounds like age and race, which also impact reproducibility.
  • Sample Size Requirements: GAN-based methods generally require more training data than traditional methods like ComBat. Research into reducing sample requirements while maintaining performance is suggested.
  • Generalizability of Classifiers: The framework is general, but designing task-specific classifiers for different downstream tasks (segmentation, regression) is an area for future exploration.

Summary updated

Abstract

Abstract Objective Multi-site collaboration is essential for overcoming small-sample problems when exploring reproducible biomarkers in MRI studies. However, various scanner-specific factors dramatically reduce the cross-scanner replicability. Moreover, existing harmony methods mostly could not guarantee the improved performance of downstream tasks. Methods we proposed a new multi-scanner harmony framework, called ‘maximum classifier discrepancy generative adversarial network’, or MCD-GAN, for removing scanner effects in the original feature space while preserving substantial biological information for downstream tasks. Specifically, the adversarial generative network was utilized for persisting the structural layout of each sample, and the maximum classifier discrepancy module was introduced for regulating GAN generators by incorporating the downstream tasks. Results We compared the MCD-GAN with other state-of-the-art data harmony approaches ( e . g ., ComBat, CycleGAN) on simulated data and the Adolescent Brain Cognitive Development (ABCD) dataset. Results demonstrate that MCD-GAN outperformed other approaches in improving cross-scanner classification performance while preserving the anatomical layout of the original images. Significance To the best of our knowledge, the proposed MCD-GAN is the first generative model which incorporates downstream tasks while harmonizing, and is a promising solution for facilitating cross-site reproducibility in various tasks such as classification and regression. The codes of the MCD-GAN are available at https://github.com/trendscenter/MCD-GAN .
BibTeX
@misc{yan2022maximum,
  author = {Weizheng Yan and Zening Fu and Rongtao Jiang and Jing Sui and Vince D. Calhoun},
  title = {{Maximum Classifier Discrepancy Generative Adversarial Network for Jointly Harmonizing Scanner Effects and Improving Reproducibility of Downstream Tasks}},
  year = {2022},
  doi = {10.1101/2022.11.19.517154},
  howpublished = {bioRxiv},
}
Figure