Federated Learning Enables Big Data for Rare Cancer Boundary Detection

Sarthak Pati, Ujjwal Baid, Brandon Edwards, Micah J. Sheller, Hans Shih-Han Wang, G. Anthony Reina, Patrick Foley, Alexey Gruzdev, Deepthi Karkada, Christos Davatzikos, Chiharu Sako, Satyam Ghodasara, Michel Bilello, Suyash Mohan, Philipp Vollmuth, Gianluca Brugnara, Chandrakanth J. Preetha, Felix Sahm, Klaus H. Maier-Hein, Maximilian Zenk, Martin Bendszus, Wolfgang Wick, Evan Calabrese, Jeffrey D. Rudie, Javier E. Villanueva-Meyer, Soonmee Cha, Madhura Ingalhalikar, Manali Jadhav, Umang Pandey, Jitender Saini, John Garrett, Matthew Larson, Robert Jeraj, Stuart Currie, Russell Frood, Kavi Fatania, Raymond Y. Huang, Ken Chang, Carmen Balaña Quintero, Jaume Capellades, Josep Puig, Johannes Trenkler, Josef Pichler, Georg Necker, Andreas Haunschmidt, Stephan Meckel, Gaurav Shukla, Spencer Liem, Gregory S. Alexander, et al.

In the field of medical artificial intelligence, the development of robust models for rare diseases is frequently hindered by the "data silo" problem. While large-scale datasets are essential for training generalized deep learning models, patient privacy regulations—such as HIPAA in the United States and GDPR in Europe—often prevent the centralization of sensitive medical records. This challenge is particularly acute for glioblastoma, a devastating brain cancer with a low incidence rate that makes it difficult for any single institution to amass a sufficient volume of data.

A landmark study published in late 2022 has addressed this bottleneck by implementing the largest federated learning (FL) study in healthcare to date. By coordinating 71 healthcare institutions across six continents, researchers successfully trained a state-of-the-art model for glioblastoma boundary detection without ever moving raw patient data from its original location.

The Challenge of Rare Disease Diagnostics

Glioblastoma occurs in approximately 3 out of every 100,000 people. For clinicians, the accurate identification of tumor boundaries—distinguishing the active tumor core from surrounding edema—is critical for surgical planning and radiotherapy. However, the scarcity of cases and the technical difficulty of moving terabytes of high-resolution MRI scans across international borders have historically limited the scope of AI research in this area.

Methodology: The Federated Approach

To overcome these barriers, the researchers utilized a Federated Learning (FL) paradigm. In this framework, the "model moves to the data" rather than the data moving to a central server.

Technical Architecture

The study employed a 3D-ResUNet architecture, a deep learning model optimized for volumetric medical imaging. This architecture combines the structural advantages of U-Net with residual connections to improve gradient flow during training. The orchestration was managed via the OpenFL framework, which facilitated the following cycle:

  1. Local Training: Each of the 71 sites received an initial global model and trained it on local data for one epoch.
  2. Aggregation: Sites sent numerical model updates (weight changes) back to a central server at the University of Pennsylvania. No raw images were transmitted.
  3. Consensus: The central server averaged these updates to create a "consensus model," which was then redistributed to the sites for the next round of training.

Data Harmonization and Optimization

To account for variations in MRI protocols across different hospitals, the team used a standardized preprocessing pipeline based on the BraTS (Brain Tumor Segmentation) challenge. Furthermore, to ensure the final model could be deployed in real-world clinical settings, the researchers applied 8-bit quantization. This optimization allowed the complex model to run efficiently on standard CPUs, reducing memory requirements by 2.29x and achieving a 4.48x speedup in inference time.

Unprecedented Scale and Diversity

The study utilized the largest glioblastoma dataset ever reported, comprising 6,314 patients and over 25,000 individual MRI scans. The training set included 5,493 cases from 49 sites, while 590 cases from 6 sites (including the American College of Radiology) were reserved for out-of-sample validation. This global diversity was crucial, as it exposed the model to a wide array of scanner hardware (Siemens, GE, Philips) and diverse patient populations, leading to superior generalization.

Key Results and Clinical Impact

The "Federated Consensus" model demonstrated significant performance gains over models trained only on publicly available data:

  • Accuracy Improvements: The model achieved a 33% improvement in detecting the Surgically Targetable Tumor (TC) and a 23% improvement for the Whole Tumor (WT).
  • Generalization: When tested on completely "unseen" hospitals, the federated model outperformed public models by 15% to 27%.
  • Privacy and Performance: The study proved that federated learning does not require a trade-off between privacy and accuracy; the FL model achieved results nearly identical to what would be expected from centralized learning.

Conclusion: A Blueprint for the Future

This research serves as a successful proof-of-concept for using federated learning to tackle rare diseases. By demonstrating that 71 institutions can collaborate securely, the authors have provided a "blueprint" for future big-data research in medicine. The ability to run these models on standard hardware through quantization further bridges the "compute gap," potentially allowing resource-limited clinics worldwide to access state-of-the-art diagnostic tools. Future work will likely focus on "continuous federated learning," where models are updated in real-time as new patients are treated, ensuring the AI evolves alongside clinical practice.

Summary updated

Abstract

Although machine learning (ML) has shown promise in numerous domains, there are concerns about generalizability to out-of-sample data. This is currently addressed by centrally sharing ample, and importantly diverse, data from multiple sites. However, such centralization is challenging to scale (or even not feasible) due to various limitations. Federated ML (FL) provides an alternative to train accurate and generalizable ML models, by only sharing numerical model updates. Here we present findings from the largest FL study to-date, involving data from 71 healthcare institutions across 6 continents, to generate an automatic tumor boundary detector for the rare disease of glioblastoma, utilizing the largest dataset of such patients ever used in the literature (25,256 MRI scans from 6,314 patients). We demonstrate a 33% improvement over a publicly trained model to delineate the surgically targetable tumor, and 23% improvement over the tumor's entire extent. We anticipate our study to: 1) enable more studies in healthcare informed by large and diverse data, ensuring meaningful results for rare diseases and underrepresented populations, 2) facilitate further quantitative analyses for glioblastoma via performance optimization of our consensus model for eventual public release, and 3) demonstrate the effectiveness of FL at such scale and task complexity as a paradigm shift for multi-site collaborations, alleviating the need for data sharing.
BibTeX
@inproceedings{pati2022federated,
  author = {Sarthak Pati and Ujjwal Baid and Brandon Edwards and Micah J. Sheller and Hans Shih-Han Wang and G. Anthony Reina and Patrick Foley and Alexey Gruzdev and Deepthi Karkada and Christos Davatzikos and Chiharu Sako and Satyam Ghodasara and Michel Bilello and Suyash Mohan and Philipp Vollmuth and Gianluca Brugnara and Chandrakanth J. Preetha and Felix Sahm and Klaus H. Maier-Hein and Maximilian Zenk and Martin Bendszus and Wolfgang Wick and Evan Calabrese and Jeffrey D. Rudie and Javier E. Villanueva-Meyer and Soonmee Cha and Madhura Ingalhalikar and Manali Jadhav and Umang Pandey and Jitender Saini and John Garrett and Matthew Larson and Robert Jeraj and Stuart Currie and Russell Frood and Kavi Fatania and Raymond Y. Huang and Ken Chang and Carmen Balaña Quintero and Jaume Capellades and Josep Puig and Johannes Trenkler and Josef Pichler and Georg Necker and Andreas Haunschmidt and Stephan Meckel and Gaurav Shukla and Spencer Liem and Gregory S. Alexander and et al.},
  title = {{Federated Learning Enables Big Data for Rare Cancer Boundary Detection}},
  booktitle = {Nature Communications},
  year = {2022},
  doi = {10.1038/s41467-022-33407-5},
}
Figure