SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Images

Hao Zheng, Hongming Li, Yong Fan

TL;DR

SurfNN is a novel deep learning framework that simultaneously reconstructs the inner (white matter) and outer (pial) surfaces of the human cerebral cortex from 3D MRIs. By jointly predicting a "midthickness" surface and the local cortical thickness, the model ensures anatomical consistency and achieves state-of-the-art accuracy in a fraction of the time required by traditional methods.

What Problem Does This Paper Address?

Mapping the folds of the human cerebral cortex—a process called Cortical Surface Reconstruction (CSR)—is essential for studying brain development and diseases like Alzheimer’s. Traditionally, this is done using software like FreeSurfer, which is highly accurate but painfully slow (taking hours) and often requires manual intervention.

Recent deep learning approaches have sped this up significantly, but they face two major hurdles:

  1. Independence Bias: Most models reconstruct the inner and outer surfaces separately, ignoring the fact that they are anatomically "coupled" (the pial surface is essentially an expanded version of the white matter surface).
  2. Architectural Complexity: Many methods rely on a messy mix of Convolutional Neural Networks (CNNs) for images and Graph Neural Networks (GNNs) for meshes, which can be difficult to train and optimize.

Methods

SurfNN simplifies the problem by focusing on the midthickness surface—the imaginary layer halfway between the inner and outer boundaries.

  • The Input: The model takes a 3D MRI and an initial "template" midthickness surface. This template is represented in two ways: explicitly as a triangular mesh and implicitly as a Signed Distance Function (SDF) map.
  • The "Y-Shape" Network: The authors use a unified Fully Convolutional Network (FCN) with two specialized branches:
  • Deformation Branch: Predicts a "Stationary Velocity Field" (SVF) to warp the initial template into the precise shape of the midthickness surface.
  • Thickness Branch: Predicts the "Half Cortical Thickness" (HCT) at every point on that surface.
  • Joint Reconstruction: Once the midthickness surface is found, the inner (white matter) and outer (pial) surfaces are generated by simply shifting the midthickness vertices inward and outward along their "normal" vectors by the predicted HCT. This ensures the two surfaces never cross and maintain a realistic relationship.

Datasets

The model was evaluated using the ADNI (Alzheimer’s Disease Neuroimaging Initiative) dataset.

  • Scale: 747 subjects for training, 70 for validation, and 113 for testing.
  • Ground Truth: Since there is no "perfect" manual gold standard for 3D surfaces, the authors used surfaces generated by FreeSurfer v7.2.0 as the surrogate ground truth for training and comparison.

Key Insights and Ideas

  • Midthickness as an Anchor: By centering the reconstruction on the midthickness surface, the model explicitly encodes the interdependence of the inner and outer boundaries. This reduces the "search space" for the network and leads to more anatomically plausible results.
  • The Power of SDF: One of the biggest "aha" moments was the impact of the Signed Distance Function. By feeding the network a 3D map of how far each voxel is from the initial surface, the authors boosted the feature extraction process. An ablation study showed that including the SDF improved accuracy by nearly 20%.
  • Efficiency through FCNs: Unlike hybrid models that struggle to pass information between voxels and mesh vertices, SurfNN stays entirely within the FCN domain until the final deformation step, making it highly efficient.

Key Results

SurfNN demonstrates a "best of both worlds" performance:

  • Accuracy: It outperformed existing explicit methods like PialNN and implicit methods like DeepCSR. Specifically, it showed a 55.2% improvement in Average Distance (AD) for pial surfaces compared to PialNN.
  • Speed: Once the initial segmentation is done, SurfNN reconstructs both surfaces in just 1.8 seconds, compared to 3.2 seconds for its closest competitor (cortexODE) and several minutes for implicit DL methods.
  • Robustness: The model maintains high accuracy even as the complexity of the surface mesh increases (tested up to ~130k vertices).

Limitations and Future Work

While SurfNN is a significant step forward, the authors note a few areas for growth:

  • Ground Truth Dependency: The model is trained on FreeSurfer outputs. This means it might inherit any systematic biases or errors present in FreeSurfer's algorithms.
  • Initialization: The method still requires an initial "ribbon segmentation" (the area between the surfaces) to create the starting template, though they successfully automated this with a 3D U-Net.
  • Clinical Application: The next logical step is to use these high-fidelity thickness maps in clinical studies to see if they can detect early-stage brain atrophy more effectively than current tools.

Summary updated

Abstract

To achieve fast, robust, and accurate reconstruction of the human cortical surfaces from 3D magnetic resonance images (MRIs), we develop a novel deep learning-based framework, referred to as SurfNN, to reconstruct simultaneously both inner (between white matter and gray matter) and outer (pial) surfaces from MRIs. Different from existing deep learning-based cortical surface reconstruction methods that either reconstruct the cortical surfaces separately or neglect the interdependence between the inner and outer surfaces, SurfNN reconstructs both the inner and outer cortical surfaces jointly by training a single network to predict a midthickness surface that lies at the center of the inner and outer cortical surfaces. The input of SurfNN consists of a 3D MRI and an initialization of the midthickness surface that is represented both implicitly as a 3D distance map and explicitly as a triangular mesh with spherical topology, and its output includes both the inner and outer cortical surfaces, as well as the midthickness surface. The method has been evaluated on a large-scale MRI dataset and demonstrated competitive cortical surface reconstruction performance.
BibTeX
@inproceedings{zheng2023surfnn,
  author = {Hao Zheng and Hongming Li and Yong Fan},
  title = {{SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Images}},
  booktitle = {ISBI},
  year = {2023},
  url = {https://openreview.net/forum?id=8WWIR5ucvr5},
}

Loading related content...

Figure