Client Recruitment for Federated Learning in ICU Length of Stay Prediction

Vincent Scheltjens, Lyse Naomi Wamba Momo, Wouter Verbeke, Bart De Moor

Federated Learning (FL) has emerged as a critical paradigm for developing machine learning models in healthcare, where data privacy is paramount. By allowing models to be trained locally at hospitals without sharing raw patient data, FL addresses many regulatory and ethical concerns. However, the practical implementation of FL faces significant hurdles, specifically data heterogeneity (Non-IID data) and high communication overhead. This paper proposes a novel "client recruitment" phase that pre-screens hospitals before training begins, selecting only the most representative sites to optimize both performance and efficiency.

The Challenges of Federated Learning in Healthcare

Standard FL algorithms, such as Federated Averaging (FedAvg), typically involve a central server coordinating with a random subset of clients in each training round. In a clinical setting, this approach encounters two primary issues:

  1. Data Heterogeneity: Patient demographics, clinical practices, and outcome distributions vary significantly between institutions (e.g., a rural clinic vs. an urban trauma center). This divergence can lead to "weight divergence," where local updates pull the global model in conflicting directions, ultimately degrading accuracy.
  2. Communication Costs: Coordinating updates across hundreds of participating hospitals is computationally expensive and slow, especially when many participants contribute "noisy" or unrepresentative data.

Methodology: The Client Recruitment Strategy

The authors propose shifting the focus from selection during training to recruitment before training. This "Client Recruitment" phase evaluates potential participants based on two non-sensitive metrics: local target distribution (Length of Stay) and sample size.

Representativeness Score

A representativeness score ($\nu_c$) is calculated for each hospital. This score balances how closely a hospital’s Length of Stay (LoS) distribution aligns with the global average against its total patient volume. The goal is to identify "typical" hospitals with sufficient data to provide statistically significant updates.

Model Architecture

The study employs a Gated Recurrent Unit (GRU) architecture. The model processes the first 24 hours of a patient's ICU stay—including vitals and laboratory results—to predict the total fractional Length of Stay.

Experimental Setup

The researchers utilized the eICU Collaborative Research Database, a multi-center dataset comprising over 200,000 admissions across 208 US hospitals. After rigorous preprocessing for data quality and focusing on adult patients, the final cohort included 89,127 patient stays across 189 hospitals. The primary task was to predict LoS in fractional days based on the initial 24-hour window of admission.

Results and Key Insights

The study compared the proposed "Subset Recruited" (Federated-SRC) model against centralized training and standard Federated Learning (Federated-SC).

  • Accuracy and Performance Parity: One of the most significant findings is that the Federated-SRC model achieved a Mean Absolute Error (MAE) of 2.21. This performance is identical to that of a centralized model where all data is pooled, and superior to standard FL selection (MAE 2.26). This suggests that including every available hospital is not only unnecessary but can be counterproductive if unrepresentative sites introduce noise into the gradient updates.
  • Computational Efficiency: The recruitment strategy yielded a massive reduction in training time. The Federated-SRC model completed training in 965 seconds, compared to 5,231 seconds for the "All Clients" (Federated-AC) approach—a 5.5x speedup.

Discussion and Future Work

The "Quality Greedy" strategy of prioritizing representative hospitals effectively reduces noise in gradient updates. By moving the filtering process to a pre-training phase, the system avoids the "sunk cost" of communicating with hospitals that do not contribute meaningful learning to the model. However, the authors note several areas for future exploration:

  • Hyperparameter Tuning: The recruitment process depends on a threshold ($\gamma_{th}$) to define "representative" hospitals, which currently requires manual tuning.
  • Real-world Latency: While the simulation accounted for computational time, real-world factors like network "stragglers" (slow connections) remain a challenge.
  • Fairness: Future recruitment criteria could incorporate patient subgroup diversity to ensure the resulting models are fair and unbiased across different demographics.

In conclusion, pre-training client recruitment offers a robust solution to the inefficiencies of standard Federated Learning in clinical settings, achieving centralized-level accuracy with a fraction of the communication cost.

Summary updated

Abstract

Machine and deep learning methods for medical and healthcare applications have shown significant progress and performance improvement in recent years. These methods require vast amounts of training data which are available in the medical sector, albeit decentralized. Medical institutions generate vast amounts of data for which sharing and centralizing remains a challenge as the result of data and privacy regulations. Federated Learning (FL) is well-suited to tackle these challenges. However, FL comes with a new set of open problems related to communication overhead, efficient parameter aggregation, client selection strategies and more. In this work, we address the step prior to the initiation of a federated network for model training, client recruitment. By intelligently recruiting clients, communication overhead and overall cost of training can be reduced without sacrificing predictive performance. Client recruitment aims at pre-excluding potential clients from partaking in the federation based on a set of criteria indicative of their eventual contributions to the federation. In this work, we propose a client recruitment approach using only the output distribution and sample size at the client site. We show how a subset of clients can be recruited without sacrificing model performance whilst significantly improving computation time. By applying the recruitment approach to the training of federated models for accurate patient Length of Stay prediction using data from 189 intensive care units (clients), we show how the models trained in federations made up from only recruited clients significantly outperform federated models trained with the standard procedure in terms of predictive power and training time.
BibTeX
@inproceedings{scheltjens2023client,
  author = {Vincent Scheltjens and Lyse Naomi Wamba Momo and Wouter Verbeke and Bart De Moor},
  title = {{Client Recruitment for Federated Learning in ICU Length of Stay Prediction}},
  booktitle = {e-Science},
  year = {2023},
  url = {https://openreview.net/forum?id=zMz52kIiC0},
}
Figure