Integrating Artificial Intelligence Tools in the Clinical Research Setting: The Ovarian Cancer Use Case

L. Escudero, Thomas Buddenkotte, Mohammad Al Sa’d, Cathal McCague, James A. d’Arcy, Leonardo Rundo, Alexander Samoshkin, Martin J. Graves, Victoria Hollamby, Paul Browne, Mireia Crispin‐Ortuzar, Ramona Woitek, Evis Sala, Carola‐Bibiane Schönlieb, Simon Doran, Ozan ÖktemDiagnostics 2023 · DOI

TL;DR

This paper presents a novel, open-source pipeline that seamlessly integrates advanced AI tools for medical image analysis into a clinical research setting. By bridging the gap between AI development and clinical application, it enables radiologists to visualize and interact with AI-generated insights, using ovarian cancer as a concrete use case for automated segmentation and treatment response prediction.

What Problem Does This Paper Address?

The paper tackles the significant challenge of translating cutting-edge AI advancements, particularly in medical image analysis, from technical research labs into practical clinical settings. While AI, especially computer vision, shows immense promise for tasks like tumor detection and delineation, these tools are often developed in isolation. This creates a disconnect, hindering their adoption by clinicians who could benefit most. The authors aim to bridge this gap by creating an accessible, user-friendly platform that simplifies the integration, testing, and deployment of AI models within academic clinical research, ultimately paving the way for their use in real-world patient care.

Methods

The core of the paper describes a technical platform built on open-source software to facilitate AI integration. Key components include:

  • XNAT (Extensible Neuroimaging Archive Toolkit): A robust, web-based framework for storing, managing, and sharing imaging data, crucial for multi-center research.
  • OHIF Viewer Plugin: Integrated with XNAT, this provides a zero-footprint, browser-based interface for visualizing medical images and interacting with AI outputs.
  • NVIDIA Clara Medical Imaging Platform & MONAI: These frameworks are leveraged for AI model development, training, and deployment. Specifically, the NVIDIA AI-Assisted Annotation (AIAA) SDK is used for integrating custom AI models.
  • Custom Inference Logic: For the ovarian cancer use case, custom inference code was developed to handle the specific input/output requirements of the AI models within the AIAA framework.
  • DL-based Segmentation: A modified U-Net architecture with a ResNet encoder was employed for automated segmentation of ovarian cancer lesions.
  • ML-based Radiomics Prediction: A random forest model, trained on radiomic features extracted from segmented lesions, was used to predict patient response to chemotherapy.

The pipeline is designed to be modular, allowing for the integration of various AI tasks beyond segmentation, such as image reconstruction and prediction.

Datasets

The paper mentions using the TCGA dataset for illustrative purposes in figures and videos. For the specific ovarian cancer use case, the authors trained their models on a dataset of high-grade serous ovarian cancer (HGSOC) patients. While the exact size and origin of this training dataset are not detailed, it's implied to be a clinically relevant dataset for developing and validating their models.

Key Insights and Ideas

  • Bridging the "AI Silo": The most significant insight is the successful creation of a practical pipeline that directly connects AI developers with clinical researchers and end-users (radiologists). This addresses the critical need for AI tools to be accessible and usable in a clinical context.
  • Open-Source and Cost-Effective: The reliance on open-source software significantly reduces the cost of research and promotes academic reproducibility, democratizing access to advanced AI capabilities.
  • User-Centric Design: The platform prioritizes usability for clinicians, allowing them to interact with AI outputs without requiring programming skills, thereby fostering trust and adoption.
  • "Patient Data to Model" Approach: The pipeline facilitates bringing AI models to patient data, rather than the other way around, which is crucial for data privacy and security, especially in multi-center collaborations.
  • Modularity and Extensibility: The architecture is designed to be flexible, allowing for the integration of diverse AI models and tasks, making it a versatile platform for various clinical research applications.

Key Results

The paper demonstrates a functional pipeline for ovarian cancer segmentation and response prediction. While specific quantitative performance metrics (e.g., segmentation accuracy, prediction AUC) are not explicitly detailed in the provided text, the key result is the successful integration and visualization of these AI models within the XNAT-OHIF viewer. The output of the segmentation model is overlaid on the CT images, and the radiomics-based prediction is visualized with different colors indicating predicted response. The paper highlights the seamless workflow from image loading to AI inference and visualization.

Limitations and Future Work

The authors acknowledge several limitations and outline future directions:

  • Work in Progress: The integration of MONAI Label for real-time model training and re-training by end-users is noted as a work in progress.
  • Generalizability of Models: The paper discusses the general concern about the stability and generalizability of DNN-based models, especially when applied to data with features deviating from the training set. This is a known challenge for AI in medical imaging.
  • Rare Cancer Types: The current availability of segmentation models is largely limited to common cancer types with abundant public datasets. Developing models for rarer cancers, which lack extensive annotated data, remains a challenge.
  • Future Expansion: The authors plan to expand the pipeline to include uncertainty quantification for segmentations, optimize reconstruction alongside segmentation, and apply the framework to other cancer types. They also aim to further collaborate with clinicians to facilitate the transition from research to clinical settings.
  • Hardware and Governance: The paper touches upon hardware requirements (AI server with GPU, repository server) and information governance, emphasizing the need for de-identified data and appropriate security measures.

Summary updated

Abstract

Artificial intelligence (AI) methods applied to healthcare problems have shown enormous potential to alleviate the burden of health services worldwide and to improve the accuracy and reproducibility of predictions. In particular, developments in computer vision are creating a paradigm shift in the analysis of radiological images, where AI tools are already capable of automatically detecting and precisely delineating tumours. However, such tools are generally developed in technical departments that continue to be siloed from where the real benefit would be achieved with their usage. Significant effort still needs to be made to make these advancements available, first in academic clinical research and ultimately in the clinical setting. In this paper, we demonstrate a prototype pipeline based entirely on open-source software and free of cost to bridge this gap, simplifying the integration of tools and models developed within the AI community into the clinical research setting, ensuring an accessible platform with visualisation applications that allow end-users such as radiologists to view and interact with the outcome of these AI tools.
BibTeX
@inproceedings{escudero2023integrating,
  author = {L. Escudero and Thomas Buddenkotte and Mohammad Al Sa’d and Cathal McCague and James A. d’Arcy and Leonardo Rundo and Alexander Samoshkin and Martin J. Graves and Victoria Hollamby and Paul Browne and Mireia Crispin‐Ortuzar and Ramona Woitek and Evis Sala and Carola‐Bibiane Schönlieb and Simon Doran and Ozan Öktem},
  title = {{Integrating Artificial Intelligence Tools in the Clinical Research Setting: The Ovarian Cancer Use Case}},
  booktitle = {Diagnostics},
  year = {2023},
  doi = {10.3390/diagnostics13172813},
}
Figure