A collaborative online AI engine for CT-based COVID-19 diagnosis

Yongchao Xu, Liya Ma, Fan Yang, Yanyan Chen, Ke Ma, Jiehua Yang, Xian Yang, Yaobing Chen, Chang Shu, Ziwei Fan, Jiefeng Gan, Xinyu Zou, Renhao Huang, Changzheng Zhang, Xiaowu Liu, Dandan Tu, Chuou Xu, Wenqing Zhang, Dehua Yang, Ming‐Wei Wang, Xi Wang, Xiaoliang Sunney Xie, Hongxiang Leng, Nagaraj-Setty Holalkere, Neil J. Halin, Ihab R. Kamel, Jia Wu, Xuehua Peng, Jianbo Shao, Pattanasak Mongkolwat, Jianjun Zhang, Daniel L. Rubin, Guoping Wang, Chuansheng Zheng, Zhen Li, Xiang Bai, Tian XiamedRxiv 2020 · DOI

Abstract

Artificial intelligence (AI) holds significant potential for streamlining chest computed tomography (CT) diagnosis of COVID-19. However, the development of robust models is often hindered by the deficiency, isolation, and heterogeneity of data across diverse institutions. These factors lead to a lack of generalization, preventing clinical application. To address this, we propose the Unified CT-COVID AI Diagnostic Initiative (UCADI), a decentralized federated learning framework. In this architecture, the AI model is distributed to host institutions for local training and inference without sharing individual patient data. Our results demonstrate that while a model trained on a single site's data fails to generalize to external institutions (dropping from 97.5% to 72% sensitivity), the federated UCADI model restores performance, achieving 98% sensitivity on external datasets. This framework provides a scalable, privacy-preserving solution for global medical AI collaboration.

Introduction

The rapid spread of COVID-19 necessitated efficient diagnostic tools. While chest CT scans are a primary diagnostic modality, the manual interpretation of these scans is time-consuming and subject to radiologist fatigue. AI models offer a solution, yet they frequently encounter the "data silo" problem. Privacy regulations and the sheer volume of medical imaging data make it difficult to centralize datasets for training. Furthermore, models trained at a single site often suffer from a "generalization gap"—a sharp decline in accuracy when applied to data from different scanners or patient populations.

This paper introduces UCADI (Unified CT-COVID AI Diagnostic Initiative), a federated learning-based engine designed to facilitate collaborative AI development without compromising patient privacy.

The UCADI Framework and Methodology

The core of UCADI is a decentralized architecture that allows multiple institutions to contribute to a global model while keeping their raw data behind local firewalls.

Federated Learning (FL)

Unlike traditional centralized training, UCADI utilizes Federated Learning. In this setup, the AI model is sent to each participating hospital. Training occurs locally on the hospital’s own hardware. Only the model gradients—the mathematical updates learned from the data—are transmitted back to a central server.

Privacy and Encryption

To ensure that sensitive information cannot be reconstructed from these gradients, the framework implements Learning with Errors (LWE)-based additively homomorphic encryption. This ensures that the central server only sees encrypted updates, which are then aggregated to refine the "Global Model."

Model Architecture

The initiative utilizes a 3D-Densenet architecture. This convolutional neural network (CNN) is specifically optimized for volumetric data, allowing the model to capture spatial features across the entire 3D stack of a CT scan, rather than analyzing individual 2D slices in isolation.

Experimental Setup and Datasets

The study utilized a robust clinical dataset to train and validate the framework:

  • Primary Training Set: 5,732 CT images from 1,276 individuals across three branches of Tongji Hospital in Wuhan. This dataset included COVID-19 cases, other viral pneumonias (e.g., Influenza A, RSV), bacterial pneumonia, and healthy controls.
  • External Validation Set: 507 COVID-19 cases from Wuhan Union Hospital (WU) were used to test the model's ability to generalize to a new clinical environment with different imaging protocols.

Results and Discussion

The Generalization Cliff

Initial experiments highlighted the critical need for federated approaches. An AI model trained exclusively on Tongji Hospital data performed exceptionally well on its internal test set (97.5% sensitivity). However, when tested on the Wuhan Union Hospital dataset, sensitivity plummeted to 72%. This 25.5% drop illustrates the "generalization cliff" caused by data heterogeneity between institutions.

Bridging the Gap with UCADI

By implementing the federated model—which integrated insights from both Tongji and Wuhan Union without transferring raw data—the sensitivity on the external Wuhan Union test cases rose to 98%. This performance was achieved while maintaining high accuracy on the original Tongji data, proving that collaborative training significantly enhances model robustness.

AI vs. Human Performance

In a comparative study, the AI model achieved a sensitivity of 97.5%, significantly outperforming a group of six experienced radiologists who averaged 79% sensitivity. This suggests that the UCADI engine can serve as a vital "second opinion," particularly in high-pressure clinical settings where the risk of false negatives is high.

Multi-Class and Severity Assessment

The model demonstrated versatility beyond binary diagnosis. It successfully distinguished COVID-19 from other viral pneumonias (AUC 0.88) and bacterial pneumonia (AUC 0.91). Additionally, the model was able to categorize the severity of COVID-19 infections into three levels with high accuracy (AUC 0.92–0.95), providing clinicians with actionable prognostic information.

Conclusion

The UCADI framework demonstrates that federated learning can effectively overcome the barriers of data isolation and heterogeneity in medical AI. By achieving near-perfect sensitivity on external datasets without compromising patient privacy, UCADI provides a blueprint for global collaborative diagnostics. Future work will focus on optimizing hyperparameter tuning for local iterations and addressing non-IID (independent and identically distributed) data challenges through dynamic weighted averaging. The UCADI platform remains open for global participation, aiming to create a validated, world-class tool for pandemic response and beyond.

Summary updated

Abstract

Abstract Artificial intelligence can potentially provide a substantial role in streamlining chest computed tomography (CT) diagnosis of COVID-19 patients. However, several critical hurdles have impeded the development of robust AI model, which include deficiency, isolation, and heterogeneity of CT data generated from diverse institutions. These bring about lack of generalization of AI model and therefore prevent it from applications in clinical practices. To overcome this, we proposed a federated learning-based Unified CT-COVID AI Diagnostic Initiative (UCADI, http://www.ai-ct-covid.team/ ), a decentralized architecture where the AI model is distributed to and executed at each host institution with the data sources or client ends for training and inferencing without sharing individual patient data. Specifically, we firstly developed an initial AI CT model based on data collected from three Tongji hospitals in Wuhan. After model evaluation, we found that the initial model can identify COVID from Tongji CT test data at near radiologist-level (97.5% sensitivity) but performed worse when it was tested on COVID cases from Wuhan Union Hospital (72% sensitivity), indicating a lack of model generalization. Next, we used the publicly available UCADI framework to build a federated model which integrated COVID CT cases from the Tongji hospitals and Wuhan Union hospital (WU) without transferring the WU data. The federated model not only performed similarly on Tongji test data but improved the detection sensitivity (98%) on WU test cases. The UCADI framework will allow participants worldwide to use and contribute to the model, to deliver a real-world, globally built and validated clinic CT-COVID AI tool. This effort directly supports the United Nations Sustainable Development Goals’ number 3, Good Health and Well-Being, and allows sharing and transferring of knowledge to fight this devastating disease around the world.
BibTeX
@misc{xu2020collaborative,
  author = {Yongchao Xu and Liya Ma and Fan Yang and Yanyan Chen and Ke Ma and Jiehua Yang and Xian Yang and Yaobing Chen and Chang Shu and Ziwei Fan and Jiefeng Gan and Xinyu Zou and Renhao Huang and Changzheng Zhang and Xiaowu Liu and Dandan Tu and Chuou Xu and Wenqing Zhang and Dehua Yang and Ming‐Wei Wang and Xi Wang and Xiaoliang Sunney Xie and Hongxiang Leng and Nagaraj-Setty Holalkere and Neil J. Halin and Ihab R. Kamel and Jia Wu and Xuehua Peng and Xiang Wang and Jianbo Shao and Pattanasak Mongkolwat and Jianjun Zhang and Daniel L. Rubin and Guoping Wang and Chuansheng Zheng and Zhen Li and Xiang Bai and Tian Xia},
  title = {{A collaborative online AI engine for CT-based COVID-19 diagnosis}},
  year = {2020},
  doi = {10.1101/2020.05.10.20096073},
  howpublished = {medRxiv},
}
Figure