Self-pruning Graph Neural Network for Predicting Inflammatory Disease Activity in Multiple Sclerosis from Brain MR Images

Chinmay Prabhakar, Hongwei Bran Li, Johannes C. Paetzold, Timo Loehr, Chen Niu, Mark Mühlau, Daniel Rueckert, Benedikt Wiestler, Bjoern H. Menze

TL;DR

This paper introduces a novel graph neural network (GNN) approach for predicting inflammatory disease activity in Multiple Sclerosis (MS) from brain MRI scans. By representing lesions as nodes in a graph and incorporating their spatial relationships, the model achieves improved prediction accuracy and offers lesion-level explainability, a significant step forward in MS management.

What Problem Does This Paper Address?

Multiple Sclerosis (MS) is a chronic neurological disease characterized by inflammatory lesions in the brain. Accurately predicting the future activity of these lesions is crucial for effective disease assessment and personalized treatment. However, the high variability in lesion number, size, shape, and location across patients poses a significant challenge for traditional machine learning models. Existing methods often struggle to capture a comprehensive global representation of the brain that effectively incorporates these complex lesion characteristics and their spatial context. This makes it difficult to pinpoint which specific lesions are most indicative of future disease activity.

Methods

The authors propose a two-stage pipeline for MS inflammatory disease activity prediction.

  1. Lesion Detection and Feature Extraction: First, a state-of-the-art 3D segmentation network (nn-Unet) is used to identify lesions within the MRI scans. For each detected lesion, a small patch is extracted, and a self-supervised learning method (a Transformer-based masked autoencoder) is employed to extract rich, pathology-specific image features.
  2. Graph Construction and Processing: These lesion features are then used to construct a patient-specific graph. Each lesion becomes a node, initialized with its extracted features. Edges between nodes are established based on the spatial proximity of the lesions, weighted by their distance. This graph is then processed by a Graph Neural Network (GNN), specifically a Graph Convolutional Network (GCN), to learn enriched, context-aware lesion features.
  3. Self-Pruning Module (SPM): A novel self-pruning module is introduced to address the variability in lesion counts. This module learns an importance score for each lesion, allowing the model to automatically select the most critical lesions for the final prediction and discard less relevant ones. This not only reduces computational complexity but also enhances model explainability by highlighting the lesions that contribute most to the prediction.
  4. Classification Head: The features of the selected lesions are aggregated to form a graph-level representation, which is then fed into a Multi-Layer Perceptron (MLP) for the final binary classification of inflammatory disease activity.

Datasets

The study evaluates its approach on a cohort of 430 MS patients. The dataset includes FLAIR and T1w MRI scans. The inflammatory disease activity status is defined based on longitudinal subtraction imaging, identifying new or significantly enlarged lesions. The dataset provides information for one-year and two-year intervals.

Key Insights and Ideas

  • Graph Representation for Lesion Interactions: Framing MS lesion prediction as a graph classification problem is a novel approach. This allows the model to explicitly capture the spatial relationships and interactions between lesions, which are crucial biomarkers for disease activity.
  • Self-Supervised Feature Learning: Utilizing self-supervised learning for lesion feature extraction is key to obtaining robust representations without relying on extensive manual annotations for every lesion.
  • Self-Pruning for Robustness and Explainability: The self-pruning module is a significant innovation. It not only makes the model more robust to variations in lesion load but also provides a direct mechanism for understanding which lesions are deemed important for prediction, offering valuable clinical insights.
  • Decoupling Detection and Prediction: The two-stage approach effectively separates the tasks of lesion detection/feature extraction from the final prediction, allowing for specialized optimization of each stage.

Key Results

The proposed self-pruning GNN model demonstrates superior performance compared to existing CNN-based baselines.

  • One-year inflammatory disease activity prediction: Achieved an AUC of 0.67 (vs. 0.61 for baselines).
  • Two-year inflammatory disease activity prediction: Achieved an AUC of 0.66 (vs. 0.60 for baselines).

The paper also shows that incorporating the graph structure and spatial proximity is beneficial for prediction, outperforming methods that ignore these aspects. The self-pruning module consistently improved performance across different GNN architectures.

Limitations and Future Work

  • Hyperparameter Sensitivity: The performance is sensitive to hyperparameters like the retention ratio (r) in the self-pruning module and the number of neighbors (k) in the kNN graph construction. The authors found optimal values through experimentation but acknowledge this dependency.
  • Dataset Imbalance: The dataset exhibits an imbalance in favor of inflammatory disease activity, which is a common challenge in MS research. While they used a balanced batch sampler, this inherent imbalance can still impact model development.
  • Future Work: The authors suggest that their work provides a new perspective for research at the intersection of graph processing and MS disease activity prediction. Further exploration of different graph architectures and self-supervised learning techniques could yield even better results. The inherent explainability of their model opens avenues for more detailed clinical validation and integration into decision-support systems.

Summary updated

Abstract

Multiple Sclerosis (MS) is a severe neurological disease characterized by inflammatory lesions in the central nervous system. Hence, predicting inflammatory disease activity is crucial for disease assessment and treatment. However, MS lesions can occur throughout the brain and vary in shape, size and total count among patients. The high variance in lesion load and locations makes it challenging for machine learning methods to learn a globally effective representation of whole-brain MRI scans to assess and predict disease. Technically it is non-trivial to incorporate essential biomarkers such as lesion load or spatial proximity. Our work represents the first attempt to utilize graph neural networks (GNN) to aggregate these biomarkers for a novel global representation. We propose a two-stage MS inflammatory disease activity prediction approach. First, a 3D segmentation network detects lesions, and a self-supervised algorithm extracts their image features. Second, the detected lesions are used to build a patient graph. The lesions act as nodes in the graph and are initialized with image features extracted in the first stage. Finally, the lesions are connected based on their spatial proximity and the inflammatory disease activity prediction is formulated as a graph classification task. Furthermore, we propose a self-pruning strategy to auto-select the most critical lesions for prediction. Our proposed method outperforms the existing baseline by a large margin (AUCs of 0.67 vs. 0.61 and 0.66 vs. 0.60 for one-year and two-year inflammatory disease activity, respectively). Finally, our proposed method enjoys inherent explainability by assigning an importance score to each lesion for the overall prediction. Code is available at https://github.com/chinmay5/ms_ida.git.
BibTeX
@inproceedings{prabhakar2023self,
  author = {Chinmay Prabhakar and Hongwei Bran Li and Johannes C. Paetzold and Timo Loehr and Chen Niu and Mark Mühlau and Daniel Rueckert and Benedikt Wiestler and Bjoern H. Menze},
  title = {{Self-pruning Graph Neural Network for Predicting Inflammatory Disease Activity in Multiple Sclerosis from Brain MR Images}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2023},
  doi = {10.1007/978-3-031-43993-3\_22},
}
Figure