Flexible Bayesian Modelling for Nonlinear Image Registration

Mikael Brudfors, Yaël Balbastre, Guillaume Flandin, Parashkev Nachev, John Ashburner

TL;DR

This paper introduces MultiBrain, a fully unsupervised, generative framework for nonlinear image registration that handles raw, unprocessed brain scans with state-of-the-art accuracy. By modeling both anatomical shape and image appearance within a unified Bayesian graphical model, the algorithm eliminates the need for tedious pre-processing steps like skull-stripping or intensity normalization, outperforming both classical gold standards and modern deep learning models.

What Problem Does This Paper Address?

Image registration—the process of aligning multiple 3D scans into a common coordinate space—is the bedrock of neuroimaging. However, most existing tools are "picky." They often require images to be pre-processed (e.g., removing the skull or correcting for magnetic field bias) or are restricted to specific types of MRI contrasts.

Furthermore, registration is a "chicken and egg" problem: to align images well, you need to know what a "standard" brain looks like, but to define a standard brain, you need well-aligned images. The authors address this by creating a flexible, "out-of-the-box" tool that can take raw data from different scanners and modalities and perform high-quality registration by treating the problem as probabilistic inference.

Methods

The core of the paper is a Generative Model. Instead of just trying to "match pixels," the authors define a joint probability distribution that describes how a brain scan is "born" from two components:

  1. Shape ($S$): A latent tissue template (an "average" brain) that undergoes a subject-specific transformation. This transformation is diffeomorphic (smooth and invertible), combining a rigid global alignment with a complex nonlinear warping (using "geodesic shooting").
  2. Appearance ($A$): Subject-specific Gaussian Mixture Models (GMMs) that account for different tissue intensities. Crucially, the model also accounts for Intensity Non-Uniformity (INU)—the "bias field" artifacts common in MRI.

To solve this, they use a Variational Expectation-Maximization (VEM) algorithm. This is an iterative process where the model constantly refines its guess of the "average brain" and the individual warps simultaneously.

Technical Innovations: * Multi-scale Optimization: They start with a coarse grid and progressively move to finer resolutions to avoid getting stuck in local minima. * Böhning Bound: They use a specific mathematical approximation to the Hessian (the second derivative of the loss function) to ensure the optimization steps are stable and always move toward a better solution without overshooting.

Datasets

The authors evaluated their method on two primary benchmarks:

  • LPBA40: 40 T1-weighted MRIs that were already "cleaned" (skull-stripped and corrected).
  • IBSR18: 18 T1-weighted MRIs that were unprocessed and had non-isotropic voxels (lower quality), making them much harder to register.
  • Training Set (for MB-L): To create a "pre-learned" version of their model, they used 277 scans from various public sources (IXI, MICCAI2012, MRBrainS18) and hospital-curated data.

Key Insights and Ideas

  • Agnosticism is Strength: By modeling the imaging process itself (the bias field and noise), the algorithm becomes "modality agnostic." It doesn't care if the scan is T1 or T2; it learns the appearance on the fly.
  • Registration at the Tissue Level: The paper argues that registering based on underlying tissue classes (gray matter, white matter) is more robust than registering based on raw intensity values, which can vary wildly between scanners.
  • Groupwise vs. Pairwise: The model can either learn an average from a specific small group (MB-GW) or use a pre-learned global average (MB-L). The groupwise approach is particularly powerful for studies with unique populations (e.g., specific diseases or age groups).

Key Results

  • Superior Accuracy: On the challenging, unprocessed IBSR18 dataset, MultiBrain achieved a 17% increase in overlap score compared to the baseline.
  • Beating the Giants: MultiBrain outperformed ANTs (SyN) and ART, which have long been considered the gold standards in the field.
  • Competitive with Deep Learning: It also outperformed VoxelMorph, a popular state-of-the-art deep learning model, particularly on the unprocessed data where VoxelMorph’s reliance on specific pre-processing pipelines became a weakness.
  • Runtime: While slower than deep learning (which takes seconds), MultiBrain takes about 15–30 minutes on a standard CPU. This is considered "reasonable" for high-accuracy clinical or research workflows.

Limitations and Future Work

  • Computational Speed: The current implementation is CPU-based. The authors acknowledge that a GPU implementation would drastically improve runtime, potentially bringing it closer to the speed of neural networks.
  • Modality Testing: While the model is theoretically agnostic to imaging modality, the validation in this paper focused primarily on T1-weighted MRI.
  • Future Directions: The authors suggest the model could be extended for automated image segmentation, image-to-image translation, or modified to use labeled data in a semi-supervised fashion.

Summary updated

Abstract

We describe a diffeomorphic registration algorithm that allows groups of images to be accurately aligned to a common space, which we intend to incorporate into the SPM software. The idea is to perform inference in a probabilistic graphical model that accounts for variability in both shape and appearance. The resulting framework is general and entirely unsupervised. The model is evaluated at inter-subject registration of 3D human brain scans. Here, the main modeling assumption is that individual anatomies can be generated by deforming a latent ‘average’ brain. The method is agnostic to imaging modality and can be applied with no prior processing. We evaluate the algorithm using freely available, manually labelled datasets. In this validation we achieve state-of-the-art results, within reasonable runtimes, against previous state-of-the-art widely used, inter-subject registration algorithms. On the unprocessed dataset, the increase in overlap score is over 17%. These results demonstrate the benefits of using informative computational anatomy frameworks for nonlinear registration.
BibTeX
@inproceedings{brudfors2020flexible,
  author = {Mikael Brudfors and Yaël Balbastre and Guillaume Flandin and Parashkev Nachev and John Ashburner},
  title = {{Flexible Bayesian Modelling for Nonlinear Image Registration}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2020},
  url = {https://openreview.net/forum?id=CuiyLGz6N7O},
}

Loading related content...

Figure