Collaborative learning of images and geometrics for predicting isocitrate dehydrogenase status of glioma

Yiran Wei, Chao Li, Xi Chen, Carola-Bibiane Schönlieb, Stephen J. Price

Abstract

This paper presents a collaborative deep learning framework for the non-invasive prediction of isocitrate dehydrogenase (IDH) mutation status in gliomas. By integrating a 3D Convolutional Neural Network (CNN) for internal image features and a Graph Neural Network (GNN) for geometric point cloud features, the model achieves superior diagnostic performance through a joint optimization objective that enforces consensus between disparate data modalities.

Introduction

Gliomas are the most prevalent malignant brain tumors, with clinical outcomes heavily influenced by the mutation status of the isocitrate dehydrogenase (IDH) gene. Patients with IDH mutations typically exhibit significantly better survival rates. Currently, determining IDH status requires invasive surgical procedures (biopsy or resection), which carry inherent risks and high costs.

Radiogenomics—the use of MRI scans to predict genetic features—aims to provide a non-invasive alternative. However, most existing models focus exclusively on either visual texture (images) or coarse shape (geometrics). This research addresses this gap by proposing a framework that fuses these two distinct information types to improve diagnostic accuracy.

Methods

The authors propose a collaborative learning framework that processes two different representations of the same tumor simultaneously:

  1. The Image Learner (3D CNN): This branch utilizes a 3D-convolutional neural network to process multi-modal MRI data (T1, post-contrast T1, T2, and FLAIR), focusing on the internal intensity and texture of tumor voxels.
  2. The Geometric Learner (GNN): The tumor's 3D mask is converted into a "point cloud"—a set of coordinates representing the tumor's surface and structure. A Graph Neural Network then identifies hierarchical patterns in the tumor's physical geometry.
  3. Collaborative Objective: The framework employs a dual-loss function. It uses Binary Cross Entropy (BCE) for label prediction and Kullback-Leibler (KL) Divergence to force the latent features of both networks to reach a consensus, ensuring the models learn from each other during training.
Overview of the collaborative framework and point cloud convolution operations.

Experimental Setup

The study utilized multi-modal MRI data from 389 glioma patients sourced from The Cancer Imaging Archive (TCIA) and an in-house cohort. After data cleaning, the final dataset included 372 patients (103 IDH-mutant and 269 IDH-wild-type).

Key Results and Discussion

The collaborative framework outperformed both standalone models and standard benchmarks:

  • Collaborative Framework: Achieved 89.2% accuracy and 91.9% sensitivity on the test set.
  • 3D-DenseNet121 (Benchmark): Achieved 85.1% accuracy.
  • Ablation Results: The "CNN only" model (79.7% accuracy) and "GNN only" model (82.4% accuracy) were significantly less effective, highlighting the importance of the collaborative approach.

Interpretability and Insights

Interpretability tools (Grad-CAM for the CNN and GNNExplainer for the GNN) revealed that the two learners have complementary strengths. The CNN focuses primarily on internal tumor content, while the GNN is highly sensitive to irregular surface boundaries and overall "ruggedness."

Interpretability analysis using Grad-CAM for the image learner and GNNExplainer for the shape learner.

By maximizing agreement between the two networks via KL Divergence, the model forces each network to refine its internal representation based on the other's perspective, capturing hierarchical topological information that standard convolutions might otherwise miss.

Conclusion and Future Work

The integration of image-based and geometric features is critical for high-performance radiogenomics. While successful, the study noted limitations in point cloud density due to memory constraints. Future work will explore denser point clouds, deeper architectures, and the correlation between specific geometric features and biological processes like tumor invasion.

Summary updated

BibTeX
@inproceedings{wei2022collaborative,
  author = {Yiran Wei and Chao Li and Xi Chen and Carola-Bibiane Schönlieb and Stephen J. Price},
  title = {{Collaborative learning of images and geometrics for predicting isocitrate dehydrogenase status of glioma}},
  booktitle = {ISBI},
  year = {2022},
  doi = {10.1109/isbi52829.2022.9761407},
}
Figure