Superpixel-ComBat modeling: A joint approach for harmonization and characterization of inter-scanner variability in T1-weighted images

Chang‐Le Chen, Mahbaneh Eshaghzadeh Torbati, Davneet Minhas, Charles M. Laymon, Seong Jae Hwang, Murat Bilgel, Adina Crainiceanu, Hecheng Jin, Weiquan Luo, Pauline Maillard, Evan Fletcher, Ciprian M. Crainiceanu, Charles DeCarli, Howard Aizenstein, Dana TudorascuImaging 2024 · DOI

TL;DR

This paper introduces SP-ComBat, a novel method that combines superpixel segmentation with the ComBat statistical harmonization technique to address inter-scanner variability in T1-weighted MRI scans. By characterizing and removing scanner-specific signal shifts and spreads at a superpixel level, SP-ComBat significantly improves image quality and reduces variability in downstream analyses, offering a more interpretable approach to harmonization.

What Problem Does This Paper Address?

Multi-site studies using T1-weighted MRI are crucial for increasing statistical power and generalizability in clinical and research settings. However, combining data from different MRI scanners introduces significant "inter-scanner variability." This variability arises from differences in hardware, imaging protocols, and software, leading to variations in image quality (e.g., noise, contrast) and potentially affecting the accuracy of automated analyses like tissue segmentation and biomarker extraction. Existing harmonization methods, while helpful, often lack interpretability, making it difficult to understand how they correct for scanner effects and how inter-scanner variability manifests in the data. This paper aims to bridge this gap by developing a method that not only harmonizes images but also provides interpretable insights into the nature of scanner variability.

Methods

The core of this work is the SP-ComBat pipeline, which integrates two key components:

  • 3D Superpixel Parcellation: Instead of analyzing the entire image or individual voxels, the method first segments the 3D T1-weighted MRI into approximately 13,000 superpixels (clusters of voxels with similar perceptual features). This approach is more computationally efficient and helps to meet the assumptions of the ComBat model.
  • ComBat Modeling: The ComBat algorithm, traditionally used for harmonizing tabular data, is adapted to estimate scanner-specific "location" (additive) and "scale" (multiplicative) effects within each superpixel. These effects quantify the shift and spread of signal intensity distributions, respectively, for each scanner relative to a normative distribution.

The pipeline involves:

  1. Preprocessing: Standard steps like bias field correction, denoising, and global intensity normalization are applied to ensure basic image quality.
  2. Spatial Registration: Images are aligned to a standard MNI space.
  3. Superpixel Segmentation: 3D superpixels are generated from averaged subject images.
  4. ComBat Modeling: Scanner effects are estimated within each superpixel on an individual basis.
  5. Harmonization: The estimated ComBat parameters are used to linearly adjust the images, removing the identified scanner effects. A "leave-one-out" cross-validation strategy is employed to prevent bias in harmonization evaluation.

The authors also implemented VoxelComBat (a voxel-wise ComBat approach) and compared SP-ComBat to two deep learning-based methods: CALAMITI and MISPEL.

Datasets

The study utilized T1-weighted MRI data from 18 participants who underwent imaging at four different 3T MRI scanners: two Siemens systems (TIM Trio and Prisma), one Philips system (Achieva), and one General Electric (GE) system (750 W). For each participant, matched image sets were acquired within a four-month interval to minimize biological changes. This dataset, with matched scans across multiple scanners for the same individuals, is crucial for evaluating harmonization methods.

Key Insights and Ideas

  • Interpretability is Key: The paper strongly advocates for interpretable harmonization. SP-ComBat's ability to estimate and visualize "additive" and "multiplicative" effect maps provides direct insight into how scanners differ, which is often lacking in black-box deep learning methods.
  • Superpixels as a Bridge: Using superpixels as the unit of analysis for ComBat is a clever way to balance the granularity of voxel-wise analysis with the statistical assumptions and efficiency of ComBat. It allows for localized estimation of scanner effects.
  • TI Matters: The study highlights the significant impact of the inversion time (TI) acquisition parameter on signal intensity differences across scanners, particularly for GM and WM, and how SP-ComBat effectively captures these variations.
  • Preprocessing is Crucial: The research demonstrates that while denoising alone has limited impact, bias field correction significantly reduces inter-scanner variability in volumetric measures, underscoring the importance of robust preprocessing.
  • Harmonization Trade-offs: Different harmonization methods show varying performance. Deep learning methods can sometimes over-correct or lead to less consistent biological effect sizes, while SP-ComBat offers a more conservative but interpretable approach.

Key Results

  • Significant Reduction in Variability: SP-ComBat achieved a substantial improvement in image quality and a significant reduction (approximately 40.3%) in the coefficient of variation (CV) of GM volume measures across scanners compared to raw images.
  • Improved Image Quality Metrics: Harmonized images showed improved SNR in WM and CSF, more consistent SNR in GM, and significant, consistent improvement in CNR between GM and WM. Signal inhomogeneity (CJV) was also substantially reduced.
  • Effective Scanner Effect Removal: Re-estimated additive effects were closer to zero and multiplicative effects closer to one after SP-ComBat harmonization, indicating successful reduction of scanner effects.
  • Scanner Prediction Accuracy: CNN classifiers trained to predict scanner source from images showed significantly reduced accuracy after harmonization by SP-ComBat (test accuracy ~25%, close to random chance), indicating effective harmonization.
  • Preservation of Biological Signals: While deep learning methods sometimes inflated effect sizes, SP-ComBat showed a more conservative but consistent reflection of biological signals related to SVD across scanners.

Limitations and Future Work

  • Sample Size: The study acknowledges a relatively small sample size (18 participants) due to the scarcity of traveling subjects, suggesting results should be interpreted cautiously and validated on larger cohorts.
  • Superpixel Independence Assumption: The assumption of independence and identically distributed data within superpixels might be violated in some cases, potentially affecting parameter estimation. Advanced statistical methods could address this.
  • Limited Imaging Parameters: The study did not investigate the impact of different imaging parameter settings (beyond TI) or field strengths, which are known to influence image quality and contrasts.
  • Partial Volume Effects: The reliance on superpixel parcellation might lead to partial volume effects, potentially impacting tissue class assignments. Exploring alternative parcellation methods is suggested.
  • Tissue Specificity: The framework was tested only on T1-weighted images and focused on GM, WM, and CSF, leaving its applicability to other tissue types (e.g., lesions) and modalities (e.g., diffusion MRI, fMRI) unexplored. However, the core method of linear site effect removal is theoretically generalizable.
  • Future Work: The authors suggest further investigation into the impact of various imaging parameters and sequences, broader exploration of preprocessing techniques, and the development of normative distributions for image quality metrics. They also propose testing the feasibility of using pseudo-matched data for harmonization.

Summary updated

Abstract

T1-weighted imaging holds wide applications in clinical and research settings; however, the challenge of inter-scanner variability arises when combining data across scanners, which impedes multi-site research. To address this, post-acquisition harmonization methods such as statistical or deep learning approaches have been proposed to unify cross-scanner images. Nevertheless, how inter-scanner variability manifests in images and derived measures, and how to harmonize it in an interpretable manner, remains underexplored. To broaden our knowledge of inter-scanner variability and leverage it to develop a new harmonization strategy, we devised a pipeline to assess the interpretable inter-scanner variability in matched T1-weighted images across four 3T MRI scanners. The pipeline incorporates ComBat modeling with 3D superpixel parcellation algorithm (namely SP-ComBat), which estimates location and scale effects to quantify the shift and spread in relative signal distributions, respectively, concerning brain tissues in the image domain. The estimated parametric maps revealed significant contrast deviations compared to the joint signal distribution across scanners (<i>p</i>< 0.001), and the identified deviations in signal intensities may relate to differences in the inversion time acquisition parameter. To reduce the inter-scanner variability, we implemented a harmonization strategy involving proper image preprocessing and site effect removal by ComBat-derived parameters, achieving substantial improvement in image quality and significant reduction in variation of volumetric measures of brain tissues (<i>p</i>< 0.001). We also applied SP-ComBat to evaluate and characterize the performance of various image harmonization techniques, demonstrating a new way to assess image harmonization. In addition, we reported various metrics of T1-weighted images to quantify the impact of inter-scanner variation, including signal-to-noise ratio, contrast-to-noise ratio, signal inhomogeneity index, and structural similarity index. This study demonstrates a pipeline that extends the implementation of statistical ComBat method to the image domain in a practical manner for characterizing and harmonizing the inter-scanner variability in T1-weighted images, providing further insight for the studies focusing on the development of image harmonization methodologies and their applications.
BibTeX
@inproceedings{chen2024superpixel,
  author = {Chang‐Le Chen and Mahbaneh Eshaghzadeh Torbati and Davneet Minhas and Charles M. Laymon and Seong Jae Hwang and Murat Bilgel and Adina Crainiceanu and Hecheng Jin and Weiquan Luo and Pauline Maillard and Evan Fletcher and Ciprian M. Crainiceanu and Charles DeCarli and Howard Aizenstein and Dana Tudorascu},
  title = {{Superpixel-ComBat modeling: A joint approach for harmonization and characterization of inter-scanner variability in T1-weighted images}},
  booktitle = {Imaging},
  year = {2024},
  doi = {10.1162/imag\_a\_00306},
}
Figure