Introduction
Training robust deep learning models for medical image segmentation requires large, diverse datasets. However, strict data privacy regulations like HIPAA and GDPR often prevent the centralized collection of patient data. Federated Learning (FL) has emerged as a solution, allowing models to be trained across multiple institutions without sharing raw data. Despite its promise, standard FL faces a significant challenge in medical contexts: Global Drift (GD).
Domain heterogeneity—caused by variations in scanner hardware, imaging protocols, and patient populations across different hospitals—leads to divergent local model updates. When a central server averages these disparate updates, the resulting global model often "drifts" away from an optimal solution for any single domain, particularly failing on unseen target domains. This paper introduces TreeFedDG, a hierarchical framework designed to mitigate Global Drift and improve Federated Domain Generalization (FedDG).
Methodology: The Tree-Structured Framework
Unlike traditional "star" topologies that use a single global server, TreeFedDG organizes client models into a hierarchical tree structure based on their parameter similarity.
Hierarchical Parameter Aggregation
The framework clusters similar client models into nodes within a tree. Aggregation proceeds bottom-up, where models within a cluster are averaged to form a parent node. This multi-granularity approach ensures that the model captures both domain-specific nuances at the leaves and broader clinical commonalities at the root, preventing the "confusion" inherent in flat, one-size-fits-all averaging.
FedStyle: Targeted Style Mixing
To enhance robustness against domain shift, the authors propose FedStyle. This technique identifies the most dissimilar client pairs in the parameter space and mixes their image "styles" (feature statistics) during training. By exposing the model to extreme variations between the most divergent sites, it learns to extract features that are invariant to the specific "style" of any single hospital.
Similarity-Guided Inference
At deployment, TreeFedDG does not simply provide the root global model to a new, unseen hospital. Instead, it extracts features from the new site's images and identifies the most similar source hospital in the tree. It then utilizes a "model chain"—a weighted combination of models from that specific leaf up to the root—to perform the final segmentation.
Experimental Evaluation
The researchers evaluated TreeFedDG on two benchmarks: a multi-site Fundus Dataset for retinal optic disc/cup segmentation and a multi-site Prostate MRI Dataset.
Performance and Precision
TreeFedDG consistently outperformed state-of-the-art (SOTA) methods like FedAvg, FedDG, and FedEvi. On the Fundus dataset, it achieved a Dice score of 88.29%, a significant improvement over previous benchmarks. In prostate segmentation, it reached a Dice score of 90.35% and reduced the 95% Hausdorff Distance (HD95) to 7.43, indicating much sharper and more accurate anatomical boundaries.
Stability and Reliability
A critical finding was the reduction in performance variance. In clinical settings, consistency is as important as average accuracy. TreeFedDG significantly lowered the Standard Deviation (STD) of Dice scores across different sites. For instance, in optic cup segmentation, the STD dropped to 3.51, compared to 6.58 for standard FedAvg. This suggests that TreeFedDG is more reliable when deployed to new, unseen clinical environments.
Conclusion
TreeFedDG addresses the fundamental issue of Global Drift in federated medical imaging. By replacing flat aggregation with a hierarchical tree and introducing targeted style mixing, the framework achieves superior generalization and stability. While the hierarchical structure introduces some computational complexity, the gains in segmentation accuracy and cross-site reliability represent a significant step toward deployable federated AI in healthcare. Future work will focus on scaling this approach to larger networks and optimizing the feature extraction process for diverse medical niches.
Summary updated