Diffeomorphic Brain Shape Modelling Using Gauss-Newton Optimisation

Yaël Balbastre, Mikael Brudfors, Kevin Bronik, John Ashburner

TL;DR

This paper introduces a generative model for brain shape that captures population-wide variability while maintaining the flexibility to account for individual "anatomical noise." By leveraging an efficient Gauss-Newton optimization scheme and variational inference, the authors demonstrate a robust way to learn the complex covariance of brain deformations without the over-simplification common in previous dimensionality-reduction approaches.

What Problem Does This Paper Address?

In neuroimaging, "normalization" is the process of warping different brains into a common coordinate space so they can be compared. This is challenging because brains are highly variable. Ideally, we want a model that understands the "typical" ways a brain might differ from the average (e.g., age-related shrinking) to make registration more accurate.

However, modeling these deformations—specifically diffeomorphisms (smooth, invertible transformations)—is computationally expensive. Because the space of possible deformations is so high-dimensional, researchers usually rely on dimensionality reduction like Principal Component Analysis (PCA). The "gap" here is that standard PCA-based methods often "squash" the data too much, discarding fine-grained details to stay computationally feasible. This results in models that are too rigid to capture the true complexity of human neuroanatomy.

Methods

The authors propose a generative shape model based on a Probabilistic PCA (PPCA) framework, but with a few key innovations:

  1. The Velocity Field Equation: They model the initial velocity of a deformation ($v_n$) as a combination of two parts: $v_n = Wz_n + r_n$.
  2. $Wz_n$ represents the principal subspace (the major trends in the population).
  3. $r_n$ is a residual field (the "anatomical noise" unique to an individual).
  4. Variational Inference & Laplace Approximation: Instead of simple point estimates, they use variational inference to approximate the posterior distribution of the latent variables. They apply a Laplace approximation (using the second derivative of the objective function) to estimate the mean and covariance of individual subject parameters.
  5. Gauss-Newton (GN) Optimisation: To handle the non-linearity of warping images, they use GN optimization. This is more efficient than standard gradient descent because it uses second-order information (the Hessian) to find the optimal shape coordinates faster and more reliably.
  6. Categorical Data Term: Rather than working with raw MRI intensity, the model works on segmented tissue probability maps (e.g., grey matter, white matter), which makes the registration more robust to noise and intensity artifacts.

Datasets

The study utilized the OASIS (Open Access Series of Imaging Studies) cross-sectional database.

  • Training Set: The first 38 subjects.
  • Testing Set: 38 unseen subjects used to evaluate the model's robustness.
  • Preprocessing: Images were segmented using FSL to create tissue probability maps for grey and white matter, then smoothed with a 1-voxel Gaussian kernel.

Key Insights and Ideas

  • Don't Ignore the Noise: By explicitly modeling the residual field ($r_n$), the authors ensure that the model doesn't force every brain to fit perfectly into a low-dimensional "box." This allows for better alignment than models that only use principal components.
  • Biological Validation: The model’s first principal component (PG1) was found to correlate strongly with subject age. This "aha moment" confirms that the mathematical model is capturing real biological processes—in this case, the typical pattern of brain aging—without being explicitly told to look for it.
  • Invertibility Matters: By using diffeomorphisms, the model ensures that the transformations are physically plausible (no "tearing" or "folding" of brain tissue) and fully reversible.
  • Efficiency through GN: Moving from simple gradient descent to Gauss-Newton allows the researchers to process complex 3D volumes that were previously too computationally heavy for this type of Bayesian shape modeling.

Key Results

  • Qualitative Improvement: As the number of principal modes increased (from 0 to 32), the reconstructed brain template became significantly sharper and more detailed (see Fig. 2 in the paper).
  • Robustness: The model performed almost identically on seen vs. unseen data. The categorical log-likelihood for the training set was $-7.23 \pm 1.26$, while the test set was $-7.55 \pm 0.88$. This small difference indicates the model generalizes well and isn't just "memorizing" the training brains.
  • Latent Space Correlation: The latent coordinates successfully mapped out the trajectory of probable Alzheimer’s Disease (AD) subjects compared to healthy aging, suggesting the model could eventually be used as a diagnostic or predictive tool.

Limitations and Future Work

  • Basis Size: The main limitation is the memory required to store the principal bases ($W$). Because these are dense 3D fields, the authors could only learn a relatively small number of them.
  • Local Patterns: The current model looks at global variations. The authors suggest that future work should focus on "sparse and local covariance patterns" to capture variations in specific brain regions more effectively.
  • Integration: The authors aim to combine this shape model directly with segmentation models, allowing the system to work on raw MRI data rather than requiring pre-segmented images.
  • Multimodal Priors: Currently, the latent distribution is a simple Gaussian; using more complex priors (like Gaussian Mixture Models) could help the model better represent distinct sub-populations (e.g., different disease groups).

Summary updated

Abstract

Shape modelling describes methods aimed at capturing the natural variability of shapes and commonly relies on probabilistic interpretations of dimensionality reduction techniques such as principal component analysis. Due to their computational complexity when dealing with dense deformation models such as diffeomorphisms, previous attempts have focused on explicitly reducing their dimension, diminishing de facto their flexibility and ability to model complex shapes such as brains. In this paper, we present a generative model of shape that allows the covariance structure of deformations to be captured without squashing their domain, resulting in better normalisation. An efficient inference scheme based on Gauss-Newton optimisation is used, which enables processing of 3D neuroimaging data. We trained this algorithm on segmented brains from the OASIS database, generating physiologically meaningful deformation trajectories. To prove the model’s robustness, we applied it to unseen data, which resulted in equivalent fitting scores.
BibTeX
@inproceedings{balbastre2018diffeomorphic,
  author = {Yaël Balbastre and Mikael Brudfors and Kevin Bronik and John Ashburner},
  title = {{Diffeomorphic Brain Shape Modelling Using Gauss-Newton Optimisation}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2018},
  url = {https://openreview.net/forum?id=3ADH5oxeLdP},
}

Loading related content...

Figure