Automatic Subcortical Segmentation Using a Contextual Model

Jonathan H. Morra, Zhuowen Tu, Liana G. Apostolova, Amity E. Green, Arthur W. Toga, Paul M. Thompson

Abstract

Accurate segmentation of subcortical brain structures is a critical yet challenging task in neuroimaging, often hindered by low image contrast and anatomical variability. This paper introduces the Auto-Context Model (ACM), an iterative machine learning framework that unifies image appearance and spatial context. By using probability maps from previous iterations as features for the next, the model learns complex spatial relationships and significantly outperforms standard tools like FreeSurfer in both accuracy and speed.

Introduction

Segmenting subcortical structures, such as the hippocampus or caudate nucleus, is essential for tracking the progression of neurodegenerative diseases like Alzheimer’s. However, manual segmentation is labor-intensive, and automated methods are often limited by low image contrast and the complex, variable shapes of these structures.

Traditionally, approaches have been divided into "bottom-up" methods focusing on local image appearance and "top-down" methods using rigid shape priors. These components are often computed separately, leading to models that are either too sensitive to noise or too rigid to handle anatomical variation. Furthermore, many existing state-of-the-art tools are computationally expensive, often requiring over ten hours to process a single brain scan.

The Auto-Context Model (ACM)

The authors propose the Auto-Context Model (ACM) to bridge the gap between appearance and shape. The core innovation is an iterative training procedure:

  1. Initial Pass: A classifier (AdaBoost) is trained on a massive pool of over 18,000 features, including local intensities, gradients, and Haar filters. At this stage, the model relies solely on image appearance.
  2. Iterative Refinement: The algorithm generates a probability map representing the likelihood of each voxel belonging to the target structure. In subsequent iterations, the classifier is retrained using both the original image features and the probability map from the previous step.
  3. Contextual Learning: By incorporating the probability map, the model learns spatial context—effectively learning its own shape prior without needing an explicit, hand-crafted geometric model.
Visual evolution of the segmentation process across iterations (a-f) in coronal, axial, and sagittal views.

Because it avoids complex energy minimization steps during inference, the final segmentation is extremely fast.

Experimental Results

The ACM was evaluated on two primary datasets: a public caudate segmentation benchmark and a hippocampal dataset consisting of 110 3D T1-weighted MRIs from patients with Alzheimer’s Disease (AD), Mild Cognitive Impairment (MCI), and healthy controls.

Convergence and Accuracy

The researchers found that the model's performance typically levels off after about four iterations, suggesting that the spatial context is fully captured early in the process.

Quantitative convergence of the ACM showing F-value and Hausdorff Distance improvements over iterations.

Key performance metrics include:

  • Superior Accuracy: On the caudate benchmark, ACM achieved an overall score of 73.38, significantly higher than the previous state-of-the-art hybrid approach (59.71).
  • Outperforming FreeSurfer: In hippocampal segmentation, ACM showed much higher precision (0.86 vs. 0.58) and lower Hausdorff distances (3.68mm vs. 5.44mm) compared to FreeSurfer.
  • Massive Speedup: While FreeSurfer takes 10–12 hours to segment a brain, ACM takes less than one minute for the target structure.

Conclusion

The Auto-Context Model represents a significant advancement in automated brain segmentation. By treating a model’s own previous guesses as valuable features, ACM creates a self-correcting loop that learns complex anatomical shapes. While currently trained for specific structures, the ACM is a general framework with potential applications in whole-brain segmentation and other medical imaging tasks like tumor recognition.

Summary updated

Abstract

Automatically segmenting subcortical structures in brain images has the potential to greatly accelerate drug trials and population studies of disease. Here we propose an automatic subcortical segmentation algorithm using the auto context model. Unlike many segmentation algorithms that separately compute a shape prior and an image appearance model, we develop a framework based on machine learning to learn a unified appearance and context model. We trained our algorithm to segment the hippocampus and tested it on 83 brain MRIs (of 35 Alzheimer’s disease patients, 22 with mild cognitive impairment, and 26 normal healthy controls). Using standard distance and overlap metrics, the auto context model method significantly outperformed simpler learning-based algorithms (using AdaBoost alone) and the FreeSurfer system. In tests on a public domain dataset designed to validate segmentation [1] , our new algorithm also greatly improved upon a recently-proposed hybrid discriminative/generative approach [2], which was among the top three that performed comparably in a recent head-to-head competition.
BibTeX
@inproceedings{morra2008automatic,
  author = {Jonathan H. Morra and Zhuowen Tu and Liana G. Apostolova and Amity E. Green and Arthur W. Toga and Paul M. Thompson},
  title = {{Automatic Subcortical Segmentation Using a Contextual Model}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2008},
  doi = {10.1007/978-3-540-85988-8\_24},
}
Figure