A Unifying Approach to Registration, Segmentation, and Intensity Correction

Kilian M. Pohl, John W. Fisher Iii, James J. Levitt, Martha Elizabeth Shenton, Ron Kikinis, W. Eric L. Grimson, William M. Wells Iii

Introduction

In medical image analysis, three tasks are fundamental yet traditionally treated as independent steps: atlas registration, tissue segmentation, and intensity (bias field) correction. Registration aligns a standardized atlas to a patient's scan; segmentation labels specific anatomical structures; and intensity correction removes smooth variations caused by magnetic field inhomogeneities.

However, these tasks are deeply interdependent—a "chicken and egg" problem. Accurate registration requires knowing the location of structures (segmentation), while precise segmentation depends on a well-aligned atlas (registration). Sequential pipelines, which handle these tasks one after another, often propagate errors from early stages, leading to systematic biases. This paper proposes a unified Bayesian framework that solves all three problems simultaneously.

The Unified Bayesian Framework

The authors formulate the problem as a Maximum A Posteriori (MAP) estimation. They model the relationship between the observed image, the unknown true segmentation, the registration parameters, and the bias field as a single optimization problem.

To find the optimal solution, the framework employs an Expectation-Maximization (EM) algorithm:

  • E-Step: The algorithm calculates the "soft assignment" or posterior probability of each voxel belonging to a specific anatomical structure, given the current estimates of registration and the bias field.
  • M-Step: The parameters are updated. This involves estimating the image inhomogeneities (bias field) and finding the optimal registration parameters to maximize the likelihood of the observed data.
Components of the unified Bayesian framework including the raw MRI (a), atlas model (b), structure weights (c), and bias field estimation (d).

By updating these estimates iteratively, the algorithm allows the registration and segmentation to guide each other toward a globally optimal solution, adhering to the "principle of least commitment."

Hierarchical Registration

A significant innovation in this work is the hierarchical registration model. Rather than relying on a single global transformation, the authors use a two-tiered approach:

  1. Global Parameters: An affine transform captures the overall pose and scale of the head.
  2. Structure-Specific Parameters: Individual brain structures (such as the thalamus or caudate) are allowed their own residual affine deformations.

This hierarchy provides the flexibility needed to capture local anatomical variations without the instability often seen in unconstrained non-rigid registration. It is particularly effective for structures like the thalamus, which have fuzzy boundaries that are difficult to anchor using intensity alone.

Results and Robustness

The method was validated on 22 brain MRIs, comparing the "EM-Integrated" approach against standard sequential baselines (EM-Affine and EM-NonRigid). The integrated approach consistently achieved higher accuracy, particularly for subcortical structures. For instance, Thalamus segmentation reached a Dice overlap score of 89.2%, significantly outperforming the 81.4% achieved by the non-rigid sequential method.

Evolution of the segmentation and registration over 30 iterations, demonstrating robustness to initial misalignment.

Beyond accuracy, the method demonstrated remarkable robustness. Even when starting from poor initial guesses—such as cases where the patient's head was significantly tilted—the algorithm successfully converged to a precise segmentation within approximately 30 iterations.

Conclusion

By coupling registration, segmentation, and intensity correction into a single interdependent framework, this approach eliminates the systematic biases inherent in sequential processing. While the iterative nature of the EM algorithm increases computational complexity, the gains in robustness and accuracy for challenging anatomical structures represent a significant advancement in automated medical image analysis.

Summary updated

Abstract

We present a statistical framework that combines the registration of an atlas with the segmentation of magnetic resonance images. We use an Expectation Maximization-based algorithm to find a solution within the model, which simultaneously estimates image inhomogeneities, anatomical labelmap, and a mapping from the atlas to the image space. An example of the approach is given for a brain structure-dependent affine mapping approach. The algorithm produces high quality segmentations for brain tissues as well as their substructures. We demonstrate the approach on a set of 22 magnetic resonance images. In addition, we show that the approach performs better than similar methods which separate the registration and segmentation problems.
BibTeX
@inproceedings{pohl2005unifying,
  author = {Kilian M. Pohl and John W. Fisher III and James J. Levitt and Martha Elizabeth Shenton and Ron Kikinis and W. Eric L. Grimson and William M. Wells III},
  title = {{A Unifying Approach to Registration, Segmentation, and Intensity Correction}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2005},
  doi = {10.1007/11566465\_39},
}
Figure