Segmenting Thalamic Nuclei: $\mathrm {T_1}$ Maps Provide a Reliable and Efficient Solution

Anqi Feng, Zhangxing Bian, Samuel W. Remedios, Savannah Hays, Blake E. Dewey, Jiachen Zhuo, Dan Benjamini, Jerry L. PrinceiMIMIC @ MICCAI 2025 · OpenReview

TL;DR

This paper investigates the optimal MRI input modalities for segmenting thalamic nuclei, a critical task for understanding brain function and disease. They introduce a novel method combining gradient-based saliency and Monte Carlo Dropout to identify the most informative multi-TI images. Their findings reveal that $\mathrm{T_1}$ maps alone provide a robust and efficient solution, outperforming other tested contrasts and even complex multi-TI combinations.

What Problem Does This Paper Address?

Accurately segmenting the thalamus into its distinct nuclei is essential for neuroscience research and clinical applications, particularly in understanding neurological disorders and guiding interventions like deep brain stimulation. However, the thalamus's complex structure and low contrast in standard MRI sequences make this a challenging task. Researchers have explored various MRI contrasts and techniques, but there's no clear consensus on which input provides the best balance of accuracy and efficiency. This paper aims to systematically evaluate different MRI inputs, including standard structural sequences, quantitative maps, and multi-inversion time (multi-TI) images, to determine the optimal choice for thalamic nuclei segmentation.

Methods

The authors tackle this problem in two stages.

Stage 1: Selecting Informative Multi-TI Images They first focus on identifying the most valuable images from a set of 51 multi-TI images, acquired at different inversion times. To do this, they employ a novel approach that combines:

  • Gradient-based Saliency Analysis: This technique analyzes how changes in input image pixels affect the segmentation model's output, highlighting important regions.
  • Monte Carlo (MC) Dropout: By enabling dropout during inference, they simulate an ensemble of "sub-models" to obtain more stable and robust estimates of image importance, mitigating variability from single gradient computations.

These two methods are integrated to calculate an Overall Importance Score (OIS) for each input image. This score quantifies how sensitively the segmentation model's output responds to changes in each input, effectively ranking their contribution.

Stage 2: Input Modality Comparison Using the insights from Stage 1, they then compare various input configurations. These include:

  • Standard structural sequences: MPRAGE and FGATIR.
  • Quantitative maps: PD and $\mathrm{T_1}$ maps.
  • Selected subsets of multi-TI images identified in Stage 1.

A 3D U-Net model was trained for each configuration to perform segmentation.

Datasets

The study utilized MRI data collected as part of a mild traumatic brain injury (MTBI) study. The dataset comprises 24 participants: 14 healthy controls and 10 individuals with MTBI. Each participant underwent MRI scans including MPRAGE and FGATIR sequences. Manual thalamic nuclei delineations were performed, guided by the Morel Atlas, and were noted to be relatively sparse. The paper does not introduce a new benchmark dataset but rather uses existing data for their comparative study.

Key Insights and Ideas

  • $\mathrm{T_1}$ Maps Reign Supreme: The most striking finding is that $\mathrm{T_1}$ maps, when used alone, achieve performance comparable to or even better than more complex combinations of MRI contrasts, including carefully selected multi-TI images. This suggests that $\mathrm{T_1}$ maps capture the essential tissue contrast needed for thalamic nuclei segmentation.
  • PD Maps Offer Little Added Value: The study found that proton density (PD) maps did not significantly improve segmentation results when combined with $\mathrm{T_1}$ maps, indicating that $\mathrm{T_1}$ relaxation properties are the primary drivers of contrast for this task.
  • Multi-TI Complexity Isn't Always Better: While multi-TI images offer diverse contrasts, simply using all available multi-TI images did not outperform the $\mathrm{T_1}$ map-only approach. This highlights the importance of intelligent selection of informative inputs, which their OIS method aims to achieve.
  • Gradient Saliency + MC Dropout is a Powerful Feature Selection Tool: The proposed method for identifying informative multi-TI images is a novel contribution, offering a principled way to leverage deep learning models to guide data acquisition or selection for downstream tasks.

Key Results

  • Quantitative Performance: $\mathrm{T_1}$ maps (Config5) achieved a high volume-weighted average (VWA) of 80.58±3.80% true positive rate (TPR), comparable to the best performing multi-TI subset (Configs, top2 multi-TIs). Statistical analysis (Wilcoxon signed-rank test with Holm-Bonferroni correction) showed no significant difference between $\mathrm{T_1}$ maps and the top multi-TI subset, reinforcing the efficiency of using $\mathrm{T_1}$ maps alone.
  • Qualitative Performance: Visual comparisons (Figure 4) showed that structural sequence-based segmentations (MPRAGE, FGATIR) often struggled with small nuclei like PuA. $\mathrm{T_1}$ map-based segmentation provided superior qualitative outcomes with minimal differences compared to the best multi-TI configurations.
  • Efficiency: Using $\mathrm{T_1}$ maps is presented as a more efficient solution, reducing preprocessing demands compared to handling numerous multi-TI images.

Limitations and Future Work

  • Dataset Size and Generalizability: The study acknowledges that the dataset size is relatively small. External validation on diverse public datasets is challenging due to the lack of specific contrasts like FGATIR or $\mathrm{T_1}$ maps. Future work will focus on synthesizing $\mathrm{T_1}$ maps for existing datasets and developing more generalizable models.
  • External Validation: The authors note the difficulty in directly using most public datasets for evaluation due to missing key contrasts.
  • Semi-supervised/Pseudo-labeling: For datasets without manual labels, they plan to explore semi-supervised or pseudo-labeling strategies.
  • Exclusion of Other Modalities: The comparison was limited to T1w-based inputs. While modalities like T2w, diffusion MRI, and structural connectivity were excluded intentionally due to their differing information content and alignment with T1w anatomy, their potential utility for specific aspects of thalamic segmentation remains an open question.

Summary updated

Abstract

Accurate thalamic nuclei segmentation is crucial for understanding neurological diseases, brain functions, and guiding clinical interventions. However, the optimal inputs for segmentation remain unclear. This study systematically evaluates multiple MRI contrasts, including MPRAGE and FGATIR sequences, quantitative PD and \(\mathrm {T_1}\) maps, and multiple T1-weighted images at different inversion times (multi-TI), to determine the most effective inputs. For multi-TI images, we employ a gradient-based saliency analysis with Monte Carlo dropout and propose an Overall Importance Score to select the images contributing most to segmentation. A 3D U-Net is trained on each of these configurations. Results show that \(\mathrm {T_1}\) maps alone achieve strong quantitative performance and superior qualitative outcomes, while PD maps offer no added value. These findings underscore the value of \(\mathrm {T_1}\) maps as a reliable and efficient input among the evaluated options, providing valuable guidance for optimizing imaging protocols when thalamic structures are of clinical or research interest. Codes are available at T1map-for-Thalamus.
BibTeX
@inproceedings{feng2025segmenting,
  author = {Anqi Feng and Zhangxing Bian and Samuel W. Remedios and Savannah Hays and Blake E. Dewey and Jiachen Zhuo and Dan Benjamini and Jerry L. Prince},
  title = {{Segmenting Thalamic Nuclei: $\textbackslash\{\}mathrm \{T\_1\}$ Maps Provide a Reliable and Efficient Solution}},
  booktitle = {iMIMIC @ MICCAI},
  year = {2025},
  url = {https://openreview.net/forum?id=gjGqWb9Pt5},
}
Figure