Deep-learning based fully automatic segmentation of the globus pallidus interna and externa using ultra-high 7 Tesla MRI

Oren Solomon, Tara Palnitkar, Rémi Patriat, Henry Braun, Joshua E. Aman, Michael C. Park, J Vítek, Guillermo Sapiro, Noam HarelbioRxiv 2020 · DOI

TL;DR

This paper introduces GP-net, a deep learning model that automatically and accurately segments the globus pallidus (GP) in ultra-high 7 Tesla MRI scans. This advancement is crucial for precise electrode placement in deep brain stimulation (DBS) surgery, a treatment for movement disorders like Parkinson's disease, and offers a patient-specific alternative to traditional atlas-based methods.

What Problem Does This Paper Address?

Deep brain stimulation (DBS) is a highly effective treatment for movement disorders such as Parkinson's disease, dystonia, and essential tremor. The success of DBS hinges on the precise placement of electrodes within specific brain structures, particularly the globus pallidus (GP). Accurate segmentation of the GP, specifically its internal (GPi) and external (GPe) segments, is essential for surgical planning and ensuring optimal therapeutic outcomes while minimizing adverse effects. Traditional methods often rely on atlas-based segmentation, which uses averaged brain structures and can struggle to account for individual anatomical variations. This can lead to inaccuracies, especially in patients with complex or atypical anatomy. The challenge is to develop a method that can reliably and automatically segment these critical structures in a patient-specific manner, improving upon existing techniques.

Methods

The core of this work is GP-net, a fully convolutional 3D deep neural network. GP-net is built upon the U-net architecture, known for its effectiveness in medical image segmentation. Key enhancements include:

  • Attention Gated (AG) U-net: This component allows the network to automatically focus on salient features within the MRI scans, improving sensitivity and accuracy by suppressing irrelevant activations.
  • Deformable Convolutions: Some of the standard 3D convolution layers are replaced with deformable convolutions. These learn to adapt their receptive field to the local image structure, enabling more flexible and accurate segmentation of complex shapes.
  • End-to-End Training: GP-net is trained directly on pairs of 7 Tesla T2 MRI volumes and corresponding manual 3D segmentations provided by expert neurosurgeons.
  • Data Augmentation: To increase the training dataset size and improve robustness, the training images and their corresponding segmentations are mirrored along the sagittal plane.

Datasets

The study utilized a dataset of 101 subjects scanned with ultra-high 7 Tesla MRI.

  • Training Set: 58 subjects, including patients with movement disorders (Parkinson's Disease, Essential Tremor) and healthy controls.
  • Testing Set: 43 subjects, also including patients with movement disorders and healthy controls.
  • Stability Test: One healthy control subject was scanned three times over two days to assess the network's consistency.

The dataset consists of T2-weighted axial slab MRI volumes with a resolution of 0.39 x 0.39 x 1 mm³. Manual delineations of the left and right GPe and GPi were performed by three independent experts.

Key Insights and Ideas

  • Patient-Specific Segmentation is Crucial: The study strongly emphasizes that individual anatomical variability, particularly in structures like the GP, cannot be fully captured by standard atlases. GP-net's patient-specific approach is a significant step forward.
  • 7 Tesla MRI Enables Fine Detail: The use of ultra-high 7 Tesla MRI is highlighted as critical for visualizing and segmenting small subcortical structures like the GP, which are often difficult to discern in lower-field MRI.
  • Deep Learning Outperforms Atlases: The results consistently show GP-net achieving superior segmentation performance compared to established atlas-based methods across various metrics.
  • Deformable Convolutions Enhance Flexibility: The integration of deformable convolutions appears to be key in allowing the network to adapt to the complex and variable shapes of the GP.
  • Attention Mechanisms Improve Focus: The attention gates help the network to better identify and utilize relevant image features, leading to more accurate segmentations.

Key Results

  • Superior Segmentation Accuracy: GP-net achieved significantly higher Dice scores (a measure of segmentation overlap) compared to all tested atlas-based methods. For example, GP-net's average Dice score was around 0.81-0.83, while atlas-based methods ranged from 0.51-0.66.
  • Improved Localization: The Center of Mass (CoM) difference, indicating how well the segmented structure is localized, was significantly lower for GP-net (around 0.7 mm) compared to atlases (over 1.6 mm).
  • Reduced Surface Distance: The Mean Surface Distance (MSD) was also lower for GP-net (around 0.4 mm) than for atlas-based methods (0.74-1.32 mm).
  • Consistent Performance: GP-net demonstrated stable and consistent segmentation results across different patient pathologies (healthy, PD, ET) and age groups, with minimal variation.
  • No Precision-Recall Trade-off: Unlike some atlas-based methods that exhibit a trade-off between precision and recall, GP-net achieved high values for both, approaching ideal performance.
  • Fast Inference: GP-net performs inference in a single forward pass, making it significantly faster than iterative methods.

Limitations and Future Work

  • 7 Tesla MRI Dependency: Currently, GP-net is trained and validated exclusively on 7 Tesla T2 MRI data acquired with a specific protocol. Extending its robustness to other MRI field strengths (1.5T, 3T) and varying acquisition protocols is a key area for future work. This addresses the challenge of "domain shift" in deep learning.
  • Interpretability: Like many deep learning models, GP-net lacks inherent interpretability. Understanding why the network might produce sub-optimal results in rare cases (e.g., low Dice scores in a few instances) is an ongoing research challenge.
  • Extension to Other Structures: The authors suggest that GP-net's architecture can be extended to segment other subcortical structures relevant for DBS, such as the Subthalamic Nucleus (STN), Red Nucleus, and Substantia Nigra. This is an active area of investigation.
  • Lamina Border Segmentation: While GP-net accurately segments the GPe and GPi, inferring the thin lamina border between them is a potential future research direction.

Summary updated

Abstract

Abstract Deep brain stimulation (DBS) surgery has been shown to dramatically improve the quality of life for patients with various motor dysfunctions, such as those afflicted with Parkinson’s disease (PD), dystonia, and essential tremor (ET), by relieving motor symptoms associated with such pathologies. The success of DBS procedures is directly related to the proper placement of the electrodes, which requires the ability to accurately detect and identify relevant target structures within the subcortical basal ganglia region. In particular, accurate and reliable segmentation of the globus pallidus (GP) interna is of great interest for DBS surgery for PD and dystonia. In this work, we present a deep-learning based neural network, which we term GP-net, for the automatic segmentation of both the external and internal segments of the globus pallidus. High resolution 7 Tesla images from 101 subjects were used in this study; GP-net is trained on a cohort of 58 subjects, containing patients with movement disorders as well as healthy control subjects. GP-net performs 3D inference in a patient-specific manner, alleviating the need for atlas-based segmentation. GP-net was extensively validated, both quantitatively and qualitatively over 43 test subjects including patients with movement disorders and healthy control and is shown to consistently produce improved segmentation results compared with state-of-the-art atlas-based segmentations. We also demonstrate a post-operative lead location assessment with respect to a segmented globus pallidus obtained by GP-net.
BibTeX
@misc{solomon2020deep,
  author = {Oren Solomon and Tara Palnitkar and Rémi Patriat and Henry Braun and Joshua E. Aman and Michael C. Park and J Vítek and Guillermo Sapiro and Noam Harel},
  title = {{Deep-learning based fully automatic segmentation of the globus pallidus interna and externa using ultra-high 7 Tesla MRI}},
  year = {2020},
  doi = {10.1101/2020.10.15.341578},
  howpublished = {bioRxiv},
}
Figure