Multimodal Surface Matching with Higher-Order Smoothness Constraints ☆

Emma C. Robinson, Kara Garcia, Matthew F. Glasser, Zhengdao Chen, Timothy S. Coalson, Antonios Makropoulos, Jelena Božek, Robert Wright, Andreas Schuh, Matthew Webster, Jana Hutter, Anthony N. Price, Lucilio Cordero‐Grande, Emer Hughes, Nora Tusor, Philip V. Bayly, David C. Van Essen, Stephen M. Smith, A. David Edwards, Joseph V. Hajnal, Mark Jenkinson, Ben Glocker, Daniel RueckertbioRxiv 2017 · DOI

TL;DR

This paper introduces a new, more robust method for aligning brain surfaces, called higher-order Multimodal Surface Matching (MSM). By incorporating biomechanically inspired "strain" penalties, it achieves more accurate and biologically plausible alignments, especially for complex datasets like developing brains, leading to better group-level analysis.

What Problem Does This Paper Address?

Accurately aligning brain surfaces is crucial for understanding group-level brain function and structure. However, the human brain's complex folding patterns vary significantly between individuals, making precise alignment challenging. Existing methods, like the previous version of MSM, sometimes produced distortions that were too extreme to be biologically realistic, forcing a trade-off between alignment accuracy and realistic deformation. This paper aims to overcome these limitations by introducing a more sophisticated way to penalize distortions during the alignment process.

Methods

The core contribution is a new "higher-order smoothness constraint" for the MSM framework. This constraint is derived from the principles of hyperelasticity, a field that models the deformation of soft tissues. Instead of just penalizing simple pairwise differences (like in the original MSM), this new method uses "triplet" information (groups of three points) to model "strain energy density." This allows for more precise control over both the change in area (areal distortion) and the change in shape (shape distortion) of the brain surface during alignment. The authors also introduce "anatomical regularisation" (aMSM) which applies these constraints directly to the anatomical surface, rather than just the spherical projection, leading to more interpretable and biologically plausible deformations.

Datasets

The methods were tested on two main datasets:

  • Adult Human Connectome Project (HCP): Used for optimizing parameters and comparing multimodal alignment.
  • Developing Human Connectome Project (dHCP): Used to evaluate the method's performance in longitudinal modeling of developing neonatal brains.

Key Insights and Ideas

  • Biomechanics for Brain Alignment: Applying principles from material science (hyperelasticity) to brain tissue deformation provides a more physically grounded way to constrain alignment, leading to more realistic results.
  • Higher-Order Constraints Matter: Moving beyond simple pairwise comparisons to consider "triplets" of points allows for a more nuanced understanding and control of how brain surfaces deform.
  • Anatomical Regularization for Interpretability: Directly applying constraints to the 3D anatomical surface, rather than just its spherical projection, makes the resulting deformations easier to interpret biologically, especially in developmental studies.
  • Improved Neonatal Brain Analysis: The new method significantly improves the ability to track brain development by providing more accurate and interpretable longitudinal alignments.

Key Results

  • The new strain-based regularization (MSMSTR) significantly improved the sharpness and peak values of group-level fMRI statistics compared to the original MSM (MSMPAIR), FreeSurfer (FS), and Spherical Demons (SD).
  • MSMAll with strain-based regularization (SMSMSTR) showed a 20.97% increase in total cluster mass compared to MSMSulc, and comparable or better improvements over SD and FS.
  • For longitudinal alignment of neonatal brains, the anatomical MSM (aMSMSTR) method produced smoother and more biologically plausible deformations, allowing for statistically significant trend detection with a smaller sample size.
  • The new method resulted in significantly reduced areal and shape distortions compared to previous spherical methods, with peak distortions being neurobiologically plausible.

Limitations and Future Work

  • Computational Cost: The higher-order optimization, while more accurate, is computationally more expensive than the original pairwise MSM. The authors mention that further optimization strategies and code parallelization could reduce run times.
  • Spatial Constraints: The current method is still a spatially-smooth, topology-constraining approach. It cannot align brains with highly variable functional topologies, which occur in a small percentage of subjects.
  • Future Work: The authors suggest exploring alternative higher-order optimization strategies, combining spatially-constrained registration with hyper-alignment or graph matching approaches to handle variable functional topologies, and expanding studies on longitudinal fetal and neonatal cortical development.

Summary updated

Abstract

Abstract In brain imaging, accurate alignment of cortical surfaces is fundamental to the statistical sensitivity and spatial localisation of group studies; and cortical surface-based alignment has generally been accepted to be superior to volume-based approaches at aligning cortical areas. However, human subjects have considerable variation in cortical folding, and in the location of functional areas relative to these folds. This makes alignment of cortical areas a challenging problem. The Multimodal Surface Matching (MSM) tool is a flexible, spherical registration approach that enables accurate registration of surfaces based on a variety of different features. Using MSM, we have previously shown that driving cross-subject surface alignment, using areal features, such as resting state-networks and myelin maps, improves group task fMRI statistics and map sharpness. However, the initial implementation of MSM's regularisation function did not penalize all forms of surface distortion evenly. In some cases, this allowed peak distortions to exceed neu-robiologically plausible limits, unless regularisation strength was increased to a level which prevented the algorithm from fully maximizing surface alignment. Here we propose and implement a new regularisation penalty, derived from physically relevant equations of strain (deformation) energy, and demonstrate that its use leads to improved and more robust alignment of multimodal imaging data. In addition, since spherical warps incorporate projection distortions that are unavoidable when mapping from a convoluted cortical surface to the sphere, we also propose constraints that enforce smooth deformation of cortical anatomies. We test the impact of this approach for longitudinal modelling of cortical development for neonates (born between 32 and 45 weeks of post-menstrual age) and demonstrate that the proposed method increases the biological interpretability of the distortion fields and improves the statistical significance of population-based analysis relative to other spherical methods.
BibTeX
@misc{robinson2017multimodal,
  author = {Emma C. Robinson and Kara Garcia and Matthew F. Glasser and Zhengdao Chen and Timothy S. Coalson and Antonios Makropoulos and Jelena Božek and Robert Wright and Andreas Schuh and Matthew Webster and Jana Hutter and Anthony N. Price and Lucilio Cordero‐Grande and Emer Hughes and Nora Tusor and Philip V. Bayly and David C. Van Essen and Stephen M. Smith and A. David Edwards and Joseph V. Hajnal and Mark Jenkinson and Ben Glocker and Daniel Rueckert},
  title = {{Multimodal Surface Matching with Higher-Order Smoothness Constraints <sup>☆</sup>}},
  year = {2017},
  doi = {10.1101/178962},
  howpublished = {bioRxiv},
}
Figure