Human-Level Differentiation of Medulloblastoma from Pilocytic Astrocytoma: A Real-World Multicenter Pilot Study

Benedikt Wiestler, Brigitte Bison, Lars Behrens, Stefanie Tüchert, Marie Metz, Michael Griessmair, Marcus Jakob, Paul‐Gerhardt Schlegel, Vera Binder, Irene von Luettichau, Markus Metzler, Pascal D. Johann, Peter Hau, Michael C. FrühwaldCancers 2024 · DOI

TL;DR

This study presents a deep learning model capable of differentiating between two common pediatric brain tumors, medulloblastoma and pilocytic astrocytoma, with human-level accuracy. By leveraging a multicenter dataset and automated segmentation, the model achieves a remarkable 97% diagnostic accuracy, outperforming less experienced human readers and matching expert neuroradiologists.

What Problem Does This Paper Address?

Accurately distinguishing between different types of pediatric brain tumors before surgery is crucial for effective treatment planning. Medulloblastoma and pilocytic astrocytoma are the two most prevalent infratentorial pediatric brain tumors, but they often present with overlapping imaging features on MRI, making differentiation challenging. This ambiguity can impact subsequent diagnostic steps, surgical approaches, and overall patient prognosis. While deep learning has shown promise in medical imaging, its application in pediatric neuro-oncology is hindered by limited, often single-center, datasets and the inherent heterogeneity of imaging protocols across institutions. This paper aims to bridge this gap by developing and validating a robust deep learning classifier for this specific diagnostic challenge using a diverse, multicenter dataset.

Methods

The researchers developed a deep learning pipeline that first automates tumor segmentation and then classifies the segmented tumor. The core of the classification model is a patch-based 3D-DenseNet classifier. This architecture is known for its efficient feature reuse, which is beneficial for learning complex patterns from medical images.

Key methodological aspects include:

  • Automated Tumor Segmentation: The pipeline utilizes the BraTS.Toolkit, an ensemble strategy that fuses predictions from multiple top-performing algorithms to achieve robust tumor segmentation. This segmentation identifies the tumor core, which is then used to extract 3D patches for classification.
  • 3D DenseNet Architecture: A 3D convolutional version of DenseNet121 was implemented to process the volumetric MRI data. This allows the model to learn spatial relationships within the tumor.
  • Data Augmentation and Robustness: To handle the variability in imaging sequences across different centers, the model incorporated several data augmentation strategies during training. This included random cropping, gamma adjustment, Gaussian noise, and importantly, a random drop-out strategy where input sequences were randomly omitted during training. This approach enhances the model's robustness to missing or incomplete imaging data, a common issue in real-world clinical settings.
  • Patch-Based Approach: Instead of processing entire brain volumes, the model works with smaller 3D patches extracted from the segmented tumor core. This allows for more focused feature extraction and potentially reduces computational burden.
  • Expert Comparison: The performance of the deep learning model was directly compared against the diagnostic assessments of five human readers with varying levels of expertise in pediatric brain tumors.

Datasets

The study utilized a multicenter dataset comprising 195 preoperative MRI scans from pediatric and adolescent patients diagnosed with either medulloblastoma (n=69) or pilocytic astrocytoma (n=126). These scans were collected from six university medical centers in Bavaria, Germany, as part of the German HIT network and KIONET.

The dataset was split into:

  • Training cohort: 131 patients (46 medulloblastomas, 85 pilocytic astrocytomas).
  • Independent test cohort: 64 patients (23 medulloblastomas, 41 pilocytic astrocytomas).

The data included various MRI sequences such as T1w (with and without contrast), T2w, FLAIR, and ADC maps. The study explicitly notes the heterogeneity in imaging sequences and acquisition protocols across the participating centers.

Key Insights and Ideas

  • Deep Learning for Pediatric Neuro-Oncology is Feasible Despite Data Heterogeneity: The study demonstrates that a deep learning model can achieve high performance even with a dataset characterized by varying imaging sequences and acquisition protocols, a common challenge in multicenter pediatric studies.
  • Automated Segmentation is a Powerful Precursor to Classification: The integration of automated tumor segmentation with a deep learning classifier proved effective, allowing the model to focus on relevant tumor regions without manual intervention.
  • Robustness to Missing Data is Crucial: The random drop-out strategy for handling missing sequences highlights a practical approach to building reliable AI models in real-world clinical scenarios where complete datasets are rare.
  • Complementarity of Human and AI Errors: The observation that the deep learning model and human experts made different misclassifications suggests a potential for a hybrid approach where AI and human expertise can complement each other for improved diagnostic accuracy.
  • T2w Sequence is Particularly Important: While the model performed well even when individual sequences were omitted, the exclusion of T2w images led to a noticeable drop in performance, indicating its significant contribution to differentiating these tumor types.

Key Results

  • High Diagnostic Accuracy: The DenseNet classifier achieved an Area Under the Curve (AUC) of 0.986 on the independent test set.
  • 97% Correct Predictions: The model correctly predicted the tumor diagnosis in 62 out of 64 patients (97%) in the test set.
  • Minimal Misclassifications: The model misclassified only one case of each tumor type.
  • Expert-Level Performance: The classifier's accuracy was on par with experienced pediatric neuroradiologists and significantly better than less experienced readers (p < 0.05).
  • Fast Processing Time: The entire processing pipeline (registration, segmentation, and classification) took less than 5 minutes per sample on a standard workstation with a GPU.
  • Sequence Importance: Omitting ADC, FLAIR, T1w, or T1w+c sequences had minimal impact on performance, but omitting T2w sequences resulted in a noticeable drop in AUC (to 0.92).

Limitations and Future Work

  • Limited Tumor Entities: The study focused solely on medulloblastoma and pilocytic astrocytoma, excluding other common pediatric brain tumors like ependymoma or diffuse midline glioma. This limits the generalizability of the findings to a specific context.
  • Retrospective Data and Molecular Information: The retrospective nature of the study meant that molecular diagnoses (as per the 2021 WHO classification) were not always available for all cases. This precluded training classifiers for molecular alterations, which are increasingly important for diagnosis and treatment stratification.
  • Separate Segmentation and Classification: The pipeline treats segmentation and classification as separate tasks. The authors suggest that jointly optimizing these tasks could further improve performance, especially given ongoing advancements in segmentation challenges.
  • Explainable AI: The authors acknowledge the need for explainable AI (XAI) strategies to make deep learning decisions more transparent and interpretable for clinicians.
  • Future Directions: The authors propose expanding the study to include more tumor entities, utilizing prospective data, and exploring joint human-AI assessment. They also highlight the potential of integrating clinical data, other imaging modalities (like PET), and genomic analyses for a more comprehensive diagnostic approach.

Summary updated

Abstract

Medulloblastoma and pilocytic astrocytoma are the two most common pediatric brain tumors with overlapping imaging features. In this proof-of-concept study, we investigated using a deep learning classifier trained on a multicenter data set to differentiate these tumor types. We developed a patch-based 3D-DenseNet classifier, utilizing automated tumor segmentation. Given the heterogeneity of imaging data (and available sequences), we used all individually available preoperative imaging sequences to make the model robust to varying input. We compared the classifier to diagnostic assessments by five readers with varying experience in pediatric brain tumors. Overall, we included 195 preoperative MRIs from children with medulloblastoma (<i>n</i> = 69) or pilocytic astrocytoma (<i>n</i> = 126) across six university hospitals. In the 64-patient test set, the DenseNet classifier achieved a high AUC of 0.986, correctly predicting 62/64 (97%) diagnoses. It misclassified one case of each tumor type. Human reader accuracy ranged from 100% (expert neuroradiologist) to 80% (resident). The classifier performed significantly better than relatively inexperienced readers (<i>p</i> < 0.05) and was on par with pediatric neuro-oncology experts. Our proof-of-concept study demonstrates a deep learning model based on automated tumor segmentation that can reliably preoperatively differentiate between medulloblastoma and pilocytic astrocytoma, even in heterogeneous data.
BibTeX
@inproceedings{wiestler2024human,
  author = {Benedikt Wiestler and Brigitte Bison and Lars Behrens and Stefanie Tüchert and Marie Metz and Michael Griessmair and Marcus Jakob and Paul‐Gerhardt Schlegel and Vera Binder and Irene von Luettichau and Markus Metzler and Pascal D. Johann and Peter Hau and Michael C. Frühwald},
  title = {{Human-Level Differentiation of Medulloblastoma from Pilocytic Astrocytoma: A Real-World Multicenter Pilot Study}},
  booktitle = {Cancers},
  year = {2024},
  doi = {10.3390/cancers16081474},
}
Figure