Hybrid Atlas Building with Deep Registration Priors

Nian Wu, Jian Wang, Miaomiao Zhang, Guixu Zhang, Yaxin Peng, Chaomin Shen

TL;DR

This paper introduces a hybrid framework for "atlas building"—creating a representative average template from a group of medical images—that combines the rigor of classical model-based methods with the speed of deep learning. By using pre-trained registration networks as "priors," the authors achieve orders-of-magnitude speedups in template generation without sacrificing anatomical accuracy.

What Problem Does This Paper Address?

In medical imaging, an atlas is a "mean template" that represents the average anatomy of a population. It is essential for tasks like segmenting structures in new scans or studying how diseases like Alzheimer’s change brain shape over time.

Traditionally, building an "unbiased" atlas is a computational nightmare. It requires iteratively registering (aligning) every individual image in a dataset to a shifting "average" image. Because medical images are high-dimensional (millions of voxels), this iterative gradient search can take hours or even days for large cohorts.

While recent deep learning (DL) models have tried to solve this, they often lack flexibility; many require retraining the entire network from scratch whenever a new group of images needs an atlas, making them impractical for clinical workflows.

Methods

The authors propose a Hybrid Atlas Building (HAB) framework. Instead of choosing between classical optimization and pure deep learning, they use the best of both:

  1. Deep Registration Priors: They take existing, pre-trained registration networks (like VoxelMorph or Quicksilver) and use them as a "prior." Essentially, the DL model provides a very good "first guess" of how an individual image should map to the atlas.
  2. Alternating Minimization: The problem is formulated as a joint objective function. They solve it by flipping between two steps:
  3. Step A (Registration): Use the pre-trained DL model to predict the transformation (velocity fields) between the current atlas and the subjects.
  4. Step B (Atlas Update): Use a closed-form mathematical solution to update the "average" image based on those transformations.
  5. Plug-and-Play Flexibility: Because the registration is treated as a modular "prior," the framework can work with almost any modern deep-learning registration architecture without needing to modify the underlying math.

Datasets

The researchers evaluated their model using:

  • OASIS (Open Access Series of Imaging Studies): 230 T1-weighted 3D brain MRI scans of subjects aged 60 to 90.
  • Preprocessing: Images were down-sampled to $128^3$ resolution and underwent standard cleaning (skull-stripping, normalization, and affine alignment).
  • Split: 130 volumes were used to train the registration "priors," and the remaining 100 volumes were used to test the atlas-building process.

Key Insights and Ideas

  • Eliminating the Bottleneck: The "aha moment" here is realizing that the bottleneck in atlas building isn't the atlas update itself, but the gradient-based optimization of the registration. By replacing that search with a DL prediction, the bottleneck vanishes.
  • Generic Framework: Unlike previous DL-based atlas builders that are tied to a specific architecture, this method is "agnostic." If a better registration network is invented tomorrow, it can be dropped into this framework immediately.
  • No Retraining Required: Because the DL component is a pre-trained prior, you don't need to retrain the network when you get a new set of patient scans. You just run the inference.

Key Results

  • Speed: The speedup is the headline result. While traditional methods (like FLASH) or some DL-based iterative methods (like LagoMorph) can take over an hour to generate an atlas, the HAB methods complete the task in a fraction of that time—reducing the cost by orders of magnitude.
  • Accuracy: Quantitatively, the quality of the atlases remained high. The Normalized Cross-Correlation (NCC) coefficients—a measure of how well the subjects align to the resulting atlas—were approximately 0.90 to 0.92, which is on par with the much slower state-of-the-art classical methods.
  • Visual Quality: Qualitative results (Fig. 2 in the paper) show that the HAB-generated atlases are sharp and capture clear anatomical details (like the folds of the cortex), avoiding the "blurriness" that often plagues fast approximation methods.

Limitations and Future Work

  • Domain Specificity: The current study focused exclusively on 3D brain MRIs. It remains to be seen how well these priors generalize to other organs (like the heart or liver) where deformation patterns are different.
  • Resolution: The experiments were conducted on $128^3$ images. Scaling this to full-resolution clinical scans (e.g., $256^3$ or higher) will be a necessary next step.
  • Advanced Modeling: The authors suggest that this framework could be extended to multi-atlas building (creating several templates for a heterogeneous population) or longitudinal studies (tracking an individual's brain changes over years).

Summary updated

Abstract

Registration-based atlas building often poses computational challenges in high-dimensional image spaces. In this paper, we introduce a novel hybrid atlas building algorithm that fast estimates atlas from large-scale image datasets with much reduced computational cost. In contrast to previous approaches that iteratively perform registration tasks between an estimated atlas and individual images, we propose to use learned priors of registration from pre-trained neural networks. This newly developed hybrid framework features several advantages of (i) providing an efficient way of atlas building without losing the quality of results, and (ii) offering flexibility in utilizing a wide variety of deep learning based registration methods. We demonstrate the effectiveness of this proposed model on 3D brain magnetic resonance imaging (MRI) scans.
BibTeX
@inproceedings{wu2022hybrid,
  author = {Nian Wu and Jian Wang and Miaomiao Zhang and Guixu Zhang and Yaxin Peng and Chaomin Shen},
  title = {{Hybrid Atlas Building with Deep Registration Priors}},
  booktitle = {ISBI},
  year = {2022},
  doi = {10.1109/isbi52829.2022.9761670},
}

Loading related content...

Figure