Collaborative Learning of Images and Geometrics for Predicting Isocitrate Dehydrogenase Status of Glioma

Yiran Wei, Chao Li, Xi Chen, Carola-Bibiane Schönlieb, Stephen J. Price

TL;DR

Researchers have developed a collaborative deep learning framework that predicts the mutation status of a key brain tumor biomarker (IDH) non-invasively. By combining 3D Convolutional Neural Networks (CNNs) to analyze tumor "insides" with Graph Neural Networks (GNNs) to analyze tumor "shape," the model achieves higher accuracy than using either method alone.

What Problem Does This Paper Address?

Gliomas are the most common malignant brain tumors, and their clinical outcome depends heavily on the mutation status of the isocitrate dehydrogenase (IDH) gene. Patients with IDH mutations generally have significantly better survival rates. Currently, determining IDH status requires invasive surgery (biopsy or resection) to obtain tissue for sequencing, which is expensive and carries risks for the patient.

While "radiogenomics"—using MRI scans to predict genetic features—is a growing field, most models focus either on the visual texture of the tumor (images) or its rough shape (geometrics). This paper addresses the gap by finding a way to fuse these two distinct types of information to improve diagnostic accuracy without the need for a scalpel.

Methods

The authors propose a collaborative learning framework that processes two different representations of the same tumor simultaneously:

  1. The Image Learner (3D CNN): This branch uses a 3D-convolutional neural network to process multi-modal MRI data (T1, post-contrast T1, T2, and FLAIR). It focuses on the internal intensity and texture of the tumor voxels.
  2. The Geometric Learner (GNN): The researchers convert the tumor's 3D mask into a "point cloud" (a set of coordinates representing the tumor's surface and structure). A Graph Neural Network then processes these points, identifying patterns in the tumor's physical geometry.
  3. Collaborative Objective: This is the "secret sauce." Instead of just training two separate models, the framework uses a dual-loss function. It uses Binary Cross Entropy (BCE) to ensure both branches predict the right label, and Kullback-Leibler (KL) Divergence to force the latent features of both networks to reach a "consensus." This ensures the two models learn from each other during training.

Datasets

The study utilized multi-modal MRI data from 389 glioma patients across two main sources:

  • The Cancer Imaging Archive (TCIA): A well-known public repository of cancer imaging.
  • In-house Cohort: Private data from the researchers' institution. After excluding cases with missing data, the final dataset included 372 patients (103 IDH-mutant and 269 IDH-wild-type).

Key Insights and Ideas

  • Complementary Strengths: The most striking insight is that the CNN and GNN "see" different things. Interpretability tools (Grad-CAM for the CNN and GNNExplainer for the GNN) revealed that the CNN focuses primarily on the internal tumor content, while the GNN is highly sensitive to irregular surface boundaries and the tumor's overall "ruggedness."
  • The Power of Agreement: By using KL Divergence to maximize the agreement between the two networks, the model performs better than a simple ensemble. The "collaboration" forces each network to refine its internal representation based on the other's perspective.
  • Geometry Matters: Even though MRI is inherently a grid of pixels (images), treating the tumor as a geometric object (point cloud/graph) captures hierarchical topological information that standard convolutions might smooth over or miss.

Key Results

The collaborative framework outperformed both standalone models and a standard benchmark:

  • Collaborative Framework: Achieved 89.2% accuracy and 91.9% sensitivity on the test set.
  • 3D-DenseNet121 (Benchmark): Achieved 85.1% accuracy.
  • Ablation Results: The "CNN only" model (79.7% accuracy) and "GNN only" model (82.4% accuracy) were significantly less effective than the combined collaborative approach.

These results suggest that the synergy between image-based features and geometric features is critical for high-performance radiogenomics.

Limitations and Future Work

  • Data Sparsity: Due to computational memory limits, the researchers sampled only 512 points from the tumor masks for the GNN. Using denser point clouds or more complex meshes might capture even finer geometric details.
  • Model Depth: The authors noted that they plan to systematically screen deeper CNN and GNN architectures to see if further performance gains are possible.
  • Biological Interaction: Future work could involve analyzing how specific geometric features (like surface irregularity) correlate with biological processes like tumor invasion and growth speed.
  • Loss Function Exploration: The study focused on KL Divergence for collaboration; exploring other contrastive or mutual-information-based loss functions could be a promising next step.

Summary updated

Abstract

The isocitrate dehydrogenase (IDH) gene mutation status is an important biomarker for glioma patients. The gold standard of IDH mutation detection requires tumour tissue obtained via invasive approaches and is usually expensive. Recent advancement in radiogenomics provides a non-invasive approach for predicting IDH mutation based on MRI. Mean-while, tumor geometrics encompass crucial information for tumour phenotyping. Here we propose a collaborative learning framework that learns both tumor images and tumor geometrics using convolutional neural networks (CNN) and graph neural networks (GNN), respectively. Our results show that the proposed model outperforms the baseline model of 3D-DenseNet121. Further, the collaborative learning model achieves better performance than either the CNN or the GNN alone. The model interpretation shows that the CNN and GNN could identify common and unique regions of interest for IDH mutation prediction. In conclusion, collaborating image and geometric learners provides a novel approach for predicting genotype and characterising glioma.
BibTeX
@inproceedings{wei2022collaborative,
  author = {Yiran Wei and Chao Li and Xi Chen and Carola-Bibiane Schönlieb and Stephen J. Price},
  title = {{Collaborative Learning of Images and Geometrics for Predicting Isocitrate Dehydrogenase Status of Glioma}},
  booktitle = {ISBI},
  year = {2022},
  doi = {10.1109/isbi52829.2022.9761407},
}

Loading related content...

Figure