Contrast-Enhancing Lesion Segmentation in Multiple Sclerosis: A Deep Learning Approach Validated in a Multicentric Cohort

Martina Greselin, Po-Jui Lu, Lester Melie-Garcia, Mario Ocampo-Pineda, Riccardo Galbusera, Alessandro Cagol, Matthias Weigel, Nina de Oliveira Siebenborn, Esther Ruberte, Pascal Benkert, Stefanie Müller, Sebastian Finkener, Jochen Vehoff, Giulio Disanto, Oliver Findling, Andrew Chan, Anke Salmen, Caroline Pot, Claire Bridel, Chiara Zecca, Tobias Derfuss, Johanna M. Lieb, Michael Diepers, Franca Wagner, Maria I. Vargas, Renaud Du Pasquier, Patrice H. Lalive, Emanuele Pravatà, Johannes Weber, Claudio Gobbi, David Leppert, Olaf Chan-Hi Kim, Philippe C. Cattin, Robert Hoepner, Patrick Roth, Ludwig Kappos, Jens Kuhle, Cristina GranzieraBioengineering 2024 · OpenReview

TL;DR

This paper presents a deep learning model, a 3D U-Net, for automatically detecting and segmenting contrast-enhancing lesions (CELs) in multiple sclerosis (MS) patients using MRI scans. By employing a novel sampling strategy and a weighted loss function to handle imbalanced data, the model achieves promising performance, offering a potential tool to aid clinicians in MS diagnosis and monitoring.

What Problem Does This Paper Address?

Diagnosing and monitoring Multiple Sclerosis (MS) relies heavily on identifying contrast-enhancing lesions (CELs) in MRI scans. These lesions indicate active inflammation. However, manually segmenting CELs is a laborious and time-consuming process, prone to significant variability between different expert readers. This variability can impact treatment decisions and patient management. While some automated approaches exist, they often require multiple MRI sequences or exclude small lesions, limiting their clinical applicability. This paper aims to bridge this gap by developing a robust deep learning model that can accurately and automatically segment CELs, even small ones, using standard clinical MRI data.

Methods

The core of this work is a 3D U-Net architecture, a popular choice for medical image segmentation, adapted for CEL segmentation. Key methodological innovations include:

  • Sampling Strategy: To address the imbalance between scans with and without CELs, and the scarcity of CELs within scans, a specific sampling strategy was devised. For scans with CELs, one-third of the sampled patches were centered on CELs, while the remaining two-thirds focused on white matter lesions (WMLs). For scans without CELs, all patches were centered on WMLs. This ensures the model learns from both positive and negative examples, with a focus on WMLs as a proxy for potential lesion areas.
  • Weighted Loss Function: Recognizing the dataset's imbalance (more WMLs/non-CEL regions than actual CELs), a weighted loss function was introduced. This function modifies the standard dice and focal loss to give more importance to the segmentation of CELs (positive patches) by down-weighting the loss contribution from negative patches. This helps the model prioritize learning the subtle features of CELs.
  • Data Augmentation: Standard data augmentation techniques like random flipping, rotation, intensity shifting, and affine transformations were applied to the patches to improve the model's generalization capabilities and mitigate overfitting.
  • Multicentric Validation: The model was trained and validated on data from multiple centers, enhancing its robustness and generalizability to real-world clinical scenarios.

Datasets

The study utilized data from the Swiss Multiple Sclerosis Cohort (SMSC).

  • Training and Validation Data: The dataset comprised 372 MRI scans from 280 MS patients.
  • 162 patients had at least one CEL.
  • 118 patients had no CELs (serving as control cases).
  • MRI Sequences: The input data included T1-weighted (T1w) images acquired before and after gadolinium contrast administration, along with Fluid Attenuated Inversion Recovery (FLAIR) images. White matter lesion (WML) masks, derived from a deep learning approach and manually corrected, were also used in the sampling strategy.
  • Data Characteristics: The dataset included scans from 1.5- and 3-Tesla MRI systems across 7 centers. The study specifically aimed to segment lesions as small as three voxels (approximately 3 mm³), a challenging aspect for automated methods.

Key Insights and Ideas

  • The power of targeted sampling: The sampling strategy, focusing on WMLs as a proxy for potential lesion areas, was crucial. It allowed the model to learn from a broader context of MS pathology while still prioritizing the identification of actual CELs.
  • Addressing imbalance is key: The weighted loss function proved effective in improving performance, highlighting that simply using standard loss functions on imbalanced medical imaging datasets can lead to suboptimal results. The model's ability to learn from sparse, small lesions was significantly boosted by this approach.
  • Clinical relevance of small lesions: The explicit goal of segmenting very small lesions (down to 3 mm³) is a significant step towards clinical utility, as these can be easily missed by manual review or excluded by other automated methods.
  • Multicentric validation is essential: Demonstrating good performance across multiple centers suggests the model is not overly specific to a single scanner or protocol, increasing its potential for widespread adoption.

Key Results

  • Overall Performance: The model achieved a Dice Score Coefficient (DSC) of 0.76 on the test dataset for whole images.
  • Detection Accuracy: The model demonstrated a high True Positive Rate (TPR) of 0.93 and a very low False Positive Rate (FPR) of 0.02.
  • Loss Function Comparison: The weighted loss function outperformed the starting loss function, yielding a higher DSC in both patches (0.72 vs. 0.67) and whole images (0.76 vs. 0.72) on the test set.
  • Lesion Volume Performance: The model performed well across various lesion volumes, with a DSC of 0.88 for the smallest lesions (3-10 mm³) and 0.76 overall. While the number of False Negatives was higher for smaller lesions, the overall segmentation quality remained strong.

Limitations and Future Work

  • Dataset Size: The authors acknowledge that the dataset size, while multicentric, is relatively small. They plan to apply the tool to a larger dataset in future work to improve generalizability.
  • WML Mask Dependency: The current sampling strategy relies on WML masks, which may require manual correction. Future work could explore using fully automated lesion masks or entirely eliminating the need for WML masks.
  • Self-Supervised Learning: The authors suggest exploring self-supervised learning techniques to further leverage limited manually segmented data and improve model performance.
  • Feature Preservation: Integrating feature-preserving mesh networks is proposed as a way to better identify and preserve the structural characteristics of CELs.

Summary updated

Abstract

The detection of contrast-enhancing lesions (CELs) is fundamental for the diagnosis and monitoring of patients with multiple sclerosis (MS). This task is time-consuming and suffers from high intra- and inter-rater variability in clinical practice. However, only a few studies proposed automatic approaches for CEL detection. This study aimed to develop a deep learning model that automatically detects and segments CELs in clinical Magnetic Resonance Imaging (MRI) scans. A 3D UNet-based network was trained with clinical MRI from the Swiss Multiple Sclerosis Cohort. The dataset comprised 372 scans from 280 MS patients: 162 showed at least one CEL, while 118 showed no CELs. The input dataset consisted of T1-weighted before and after gadolinium injection, and FLuid Attenuated Inversion Recovery images. The sampling strategy was based on a white matter lesion mask to confirm the existence of real contrast-enhancing lesions. To overcome the dataset imbalance, a weighted loss function was implemented. The Dice Score Coefficient and True Positive and False Positive Rates were 0.76, 0.93, and 0.02, respectively. Based on these results, the model developed in this study might well be considered for clinical decision support.
BibTeX
@inproceedings{greselin2024contrast,
  author = {Martina Greselin and Po-Jui Lu and Lester Melie-Garcia and Mario Ocampo-Pineda and Riccardo Galbusera and Alessandro Cagol and Matthias Weigel and Nina de Oliveira Siebenborn and Esther Ruberte and Pascal Benkert and Stefanie Müller and Sebastian Finkener and Jochen Vehoff and Giulio Disanto and Oliver Findling and Andrew Chan and Anke Salmen and Caroline Pot and Claire Bridel and Chiara Zecca and Tobias Derfuss and Johanna M. Lieb and Michael Diepers and Franca Wagner and Maria I. Vargas and Renaud Du Pasquier and Patrice H. Lalive and Emanuele Pravatà and Johannes Weber and Claudio Gobbi and David Leppert and Olaf Chan-Hi Kim and Philippe C. Cattin and Robert Hoepner and Patrick Roth and Ludwig Kappos and Jens Kuhle and Cristina Granziera},
  title = {{Contrast-Enhancing Lesion Segmentation in Multiple Sclerosis: A Deep Learning Approach Validated in a Multicentric Cohort}},
  booktitle = {Bioengineering},
  year = {2024},
  url = {https://openreview.net/forum?id=ESfTnLpb6E},
}
Figure