A Tumour-Aware Multimodal Framework for Explainable Prediction of IDH Mutation in Gliomas from Multi-Sequence MRI

Tahsien Al-Quraishi, Waseem Alwan Zaboon, O. S. Albahri, Raza NowrozyarXiv 2026 · arXiv

TL;DR

This paper introduces a "tumour-aware" multimodal deep learning framework that non-invasively predicts IDH mutation status in gliomas with high accuracy (86.17%). By integrating multi-sequence MRI, handcrafted radiomic features, and clinical data, the model avoids the "whole-brain noise" of traditional approaches and provides explainable heatmaps to verify it is focusing on biologically relevant regions.

What Problem Does This Paper Address?

In neuro-oncology, the mutation status of the isocitrate dehydrogenase (IDH) gene is a "make or break" biomarker. Patients with IDH-mutated gliomas generally have a better prognosis and respond differently to treatment than those with "wildtype" tumours. Currently, the gold standard for identifying this mutation is an invasive surgical biopsy or resection.

While researchers have tried using deep learning to predict IDH status from non-invasive MRI scans, two major hurdles remain:

  1. Spatial Noise: Many models extract features from the entire brain volume, allowing irrelevant healthy tissue to "pollute" the learning process.
  2. The Black Box Problem: Clinicians are hesitant to trust a model that can’t explain why it made a specific prediction.

This study tackles these by proposing a unified architecture that is both spatially targeted (tumour-aware) and interpretable.

Methods

The authors developed a multimodal fusion architecture consisting of three primary branches:

  • Imaging Branch (Tumour-Aware): Instead of feeding the whole MRI into a 3D Convolutional Neural Network (CNN), the framework uses expert-annotated segmentation masks to focus feature extraction specifically on the tumour subregions (enhancing tumour, core, and edema). This ensures the 3D CNN learns representations of the pathology, not the background.
  • Radiomics Branch: The model incorporates handcrafted features using the PyRadiomics library. These include first-order statistics (intensity), shape descriptors (volume, sphericity), and texture features (GLCM, GLSZM) that capture heterogeneity often missed by deep learning alone.
  • Clinical Branch: Patient-specific variables—age, sex, and tumour grade—are encoded and fused with the imaging features.

The outputs of these branches are concatenated and passed through fully connected layers. Finally, the authors used Grad-CAM (Gradient-weighted Class Activation Mapping) to produce saliency maps, visually highlighting which parts of the tumour drove the model's decision.

Datasets

The study utilized the RSNA–ASNR–MICCAI BraTS 2021 dataset, a well-known benchmark in the field.

  • Cohort: 622 patients with complete multiparametric MRI and confirmed IDH status.
  • Modalities: Four MRI sequences per patient: T1, T1-contrast enhanced (T1CE), T2, and FLAIR.
  • Labels: The dataset included expert-annotated tumour masks and clinical metadata.

Key Insights and Ideas

  • Synergy of "Old" and "New" Features: A major takeaway is that handcrafted radiomics and deep learning features are complementary. Radiomics provides explicit geometric and textural measurements, while the CNN captures abstract spatial hierarchies. Together, they outperform either method in isolation.
  • The Power of Localization: The ablation study revealed that simply moving from a standard CNN to a "tumour-aware" ensemble (focusing only on the lesion) jumped the Area Under the Curve (AUC) from 0.684 to 0.895. This confirms that "less is more" when it comes to the input volume for medical imaging models.
  • Clinical Context is the Final Polish: While imaging features did the heavy lifting, adding clinical variables like age and tumour grade provided the final boost in performance, particularly in refining the model's precision.
Table 1: Comparison of MRI-based IDH mutation prediction methods

Key Results

The proposed Clinical Fusion model significantly outperformed baseline approaches across all metrics:

  • Accuracy: 86.17% (vs. 64.89% for a baseline MRI-only CNN).
  • AUC: 0.944 (indicating excellent discriminative power).
  • Recall (Sensitivity): 88.89%, which is crucial for clinical settings where missing a mutation (a false negative) could lead to suboptimal treatment.
  • Explainability: Grad-CAM visualizations confirmed that the model’s "attention" was concentrated within the segmented tumour boundaries, providing a layer of biological verification for clinicians.

Limitations and Future Work

Despite the strong results, the authors note several areas for improvement:

  • External Validation: The model was trained and tested on the BraTS dataset. To be truly "clinic-ready," it needs to be validated on independent, multi-centre datasets with different scanner types and protocols.
  • Narrow Scope: The current framework focuses only on IDH. Future iterations should aim to predict a broader molecular profile, including 1p/19q codeletion and MGMT promoter methylation.
  • Qualitative vs. Quantitative XAI: While Grad-CAM provides a "gut check" for where the model is looking, the authors suggest moving toward quantitative explainability metrics to measure exactly how much each feature contributes to the final score.

Summary updated

Abstract

Accurate prediction of isocitrate dehydrogenase (IDH) mutation status is essential for glioma diagnosis, prognosis, and treatment planning. Although recent deep learning approaches have demonstrated promising performance, many rely on whole-brain feature extraction and provide limited interpretability. This study proposes a tumour-aware multimodal framework for explainable, non-invasive prediction of IDH mutation status from multiparametric magnetic resonance imaging (MRI). The proposed framework integrates four MRI sequences (T1, T1CE, T2, and FLAIR), tumour subregion segmentation, quantitative radiomic descriptors, and clinical information within a unified deep learning architecture. An ablation study was conducted to evaluate the contribution of tumour-aware learning, radiomic features, and clinical variables. Model performance was assessed using multiple complementary evaluation metrics, including accuracy, precision, recall, F1-score, balanced accuracy, receiver operating characteristic analysis, confusion matrix evaluation, and Grad-CAM visualisation. Experimental results demonstrated that the proposed multimodal framework consistently outperformed the baseline MRI-only model, with the Clinical Fusion model achieving the strongest overall predictive performance. The integration of tumour-aware learning, radiomic descriptors, and clinical information progressively improved classification performance, while Grad-CAM visualisations indicated that the model predominantly focused on biologically relevant tumour regions. These findings suggest that tumour-aware multimodal feature integration enables accurate, interpretable, and non-invasive molecular profiling of gliomas and provides a promising foundation for future clinical decision support in precision neuro-oncology.
BibTeX
@misc{alquraishi2026tumour,
  author = {Tahsien Al-Quraishi and Waseem Alwan Zaboon and O. S. Albahri and Raza Nowrozy},
  title = {{A Tumour-Aware Multimodal Framework for Explainable Prediction of IDH Mutation in Gliomas from Multi-Sequence MRI}},
  year = {2026},
  eprint = {2611.17712},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.17712},
}
Figure