Fed-ComBat: A Generalized Federated Framework for Batch Effect Harmonization in Collaborative Studies

Santiago Silva, Neil P. Oxtoby, André Altmann, Marco LorenzibioRxiv 2023 · DOI

TL;DR

This paper introduces Fed-ComBat, a novel federated learning framework for harmonizing data across multiple research sites without centralizing sensitive patient information. It extends existing methods to effectively handle complex, non-linear relationships in data, outperforming previous approaches in simulated scenarios and showing comparable results to centralized methods on real-world neuroimaging data.

What Problem Does This Paper Address?

In collaborative research, especially in fields like neuroimaging, combining data from multiple institutions (multi-centric studies) is crucial for achieving sufficient sample sizes and diverse patient populations. However, traditional data harmonization techniques often require centralizing all data, which raises significant privacy concerns and can conflict with regulations like GDPR and CCPA. This data governance challenge hinders researchers' ability to access and analyze valuable datasets. Federated learning offers a solution by allowing models to be trained on decentralized data, but existing federated harmonization methods have limitations, particularly in handling non-linear relationships and interactions between variables. This paper aims to bridge this gap by proposing a generalized federated framework that can capture these complex effects while preserving data privacy.

Methods

The core of Fed-ComBat is a generalized ComBat model adapted for a federated learning setting. It builds upon the original ComBat formulation but uses flexible, non-parametric models for covariate effects, allowing for the use of neural networks (specifically, Multi-Layer Perceptrons or MLPs) as "kernel functions." This allows Fed-ComBat to automatically learn and account for non-linear covariate effects and their interactions without requiring explicit specification beforehand, unlike methods like ComBat-GAM.

The framework operates in a federated manner:

  1. Local Optimization: Each participating site trains a local model using its data, optimizing the parameters via Stochastic Gradient Descent (SGD).
  2. Aggregation: Model updates (parameters) are aggregated across all sites using a federated averaging (FedAVG) approach on a central server.
  3. Random Effect Estimation: After global parameter updates, local random effects are estimated using empirical Bayes, similar to the original ComBat.

This process is iterated until convergence, ensuring that data remains decentralized throughout the harmonization process. The paper also introduces SGD-ComBat as a centralized counterpart to Fed-ComBat, which uses SGD for optimization and serves as a benchmark.

Datasets

The authors evaluated Fed-ComBat on two main types of data:

  • Synthetic Data: Generated to simulate various batch and covariate-wise heterogeneities, including linear, non-linear, and mixed generation schemes for unbiased phenotypes.
  • Real Brain MRI Data: A cross-sectional cohort of 13,479 participants from seven public studies (ADNI, AIBL, ABIDE, OASIS, PPMI, A4, and LEARN). These studies involved participants with and at risk of neurodegenerative disorders like Parkinson's disease, Alzheimer's disease, and autism spectrum disorder. Phenotypes were derived from structural T1-weighted MRI scans.

Key Insights and Ideas

  • Privacy-Preserving Harmonization: The most significant contribution is enabling data harmonization without centralizing sensitive patient data, a critical need in modern collaborative research.
  • Flexible Non-Linearity Capture: Fed-ComBat's ability to automatically learn and model complex non-linear covariate effects and interactions using MLPs is a major advancement over methods requiring pre-defined models or explicit interaction terms.
  • Generalization of ComBat: The framework provides a generalized ComBat formulation that can accommodate various models (linear, MLP, etc.), making it adaptable to different harmonization challenges.
  • Federated vs. Centralized Performance: The study demonstrates that federated approaches can achieve performance comparable to their centralized counterparts, even with the added complexity of decentralized data and communication rounds.

Key Results

  • Synthetic Data Performance: Fed-ComBat showed a significant improvement in reconstructing the target unbiased function, achieving a 35% improvement in RMSE compared to d-ComBat and a 12% improvement compared to a federated version of ComBat-GAM.
  • Real Data Harmonization: Fed-ComBat (MLP version) demonstrated comparable results to centralized methods like ComBat-GAM on real neuroimaging data, effectively capturing non-linear age-related trajectories without prior knowledge of these non-linearities.
  • Comparison to Existing Methods: Fed-ComBat performed better than centralized ComBat when dealing with non-linear effects and was on par with ComBat-GAM. The MLP version of Fed-ComBat was noted to be more generalizable than ComBat-GAM.
  • Residual Analysis: Residual variance was significantly reduced for Fed-ComBat and ComBat-GAM compared to NeuroComBat, indicating better harmonization.

Limitations and Future Work

  • Computational Resources & Connectivity: Federated learning inherently requires significant computational resources and stable network connectivity at each site, which can be a practical challenge.
  • Heterogeneity: Extreme disparities in data distributions, demographics, or collection protocols across institutions can challenge the method's ability to rectify biases.
  • Optimization: The current implementation uses SGD, which could be improved, especially for highly heterogeneous data. Exploring methods like FedProx is suggested.
  • Direct Imaging Data Application: The current implementation focuses on derived phenotypes. Future work could explore adapting Fed-ComBat to handle raw imaging data directly using Convolutional Neural Networks (CNNs).
  • Platform Integration: Making Fed-ComBat available on platforms like COINSTAC and Fed-BioMed would enable real-scenario evaluations.
  • Larger Cohorts: Evaluating Fed-ComBat on larger cohorts would provide further validation of its effectiveness.

Summary updated

Abstract

In neuroimaging research, the utilization of multi-centric analyses is crucial for obtaining sufficient sample sizes and representative clinical populations. Data harmonization techniques are typically part of the pipeline in multi-centric studies to address systematic biases and ensure the comparability of the data. However, most multi-centric studies require centralized data, which may result in exposing individual patient information. This poses a significant challenge in data governance, leading to the implementation of regulations such as the GDPR and the CCPA, which attempt to address these concerns but also hinder data access for researchers. Federated learning offers a privacy-preserving alternative approach in machine learning, enabling models to be collaboratively trained on decentralized data without the need for data centralization or sharing. In this paper, we present Fed-ComBat, a federated framework for batch effect harmonization on decentralized data. Fed-ComBat extends existing centralized linear methods, such as ComBat and distributed as d-ComBat, and nonlinear approaches like ComBat-GAM in accounting for potentially nonlinear and multivariate covariate effects. By doing so, Fed-ComBat enables the preservation of nonlinear covariate effects without requiring centralization of data and without prior knowledge of which variables should be considered nonlinear or their interactions, differentiating it from ComBat-GAM. We assessed Fed-ComBat and existing approaches on simulated data and multiple cohorts comprising healthy controls (CN) and subjects with various disorders such as Parkinson's disease (PD), Alzheimer's disease (AD), and autism spectrum disorder (ASD). The results of our study show that Fed-ComBat performs better than centralized ComBat when dealing with nonlinear effects and is on par with centralized methods like ComBat-GAM. Through experiments using synthetic data, Fed-ComBat demonstrates a superior ability to reconstruct the target unbiased function, achieving a 35% improvement (RMSE=0.5952) compared to d-ComBat (RMSE=0.9162) and a 12% improvement compared to our proposal to federate ComBat-GAM, d-ComBat-GAM (RMSE=0.6751). Additionally, Fed-ComBat achieves comparable results to centralized methods like ComBat-GAM for MRI-derived phenotypes without requiring prior knowledge of potential nonlinearities.
BibTeX
@misc{silva2023fed,
  author = {Santiago Silva and Neil P. Oxtoby and André Altmann and Marco Lorenzi},
  title = {{Fed-ComBat: A Generalized Federated Framework for Batch Effect Harmonization in Collaborative Studies}},
  year = {2023},
  doi = {10.1101/2023.05.24.542107},
  howpublished = {bioRxiv},
}
Figure