Review of deep learning methods for isointense infant brain MR image segmentation

Hang Zhang, Yaping Wang, Xiujuan Geng, Pengfei FuJournal of Image and Graphics 2020 · DOI

TL;DR

This paper provides a comprehensive review of deep learning techniques specifically designed to segment infant brain MRIs during the "isointense" phase (6–9 months old). By analyzing state-of-the-art architectures like 3D-U-Net and DenseNet on the iSeg-2017 benchmark, the authors demonstrate how deep learning overcomes the extreme low-contrast hurdles that baffle traditional imaging algorithms.

What Problem Does This Paper Address?

The first year of life is the most dynamic period for human brain development. To study this, researchers need to segment brain MRIs into three primary tissues: Gray Matter (GM), White Matter (WM), and Cerebrospinal Fluid (CSF).

However, at the isointense stage (roughly 6 to 9 months of age), the brain undergoes rapid myelination. This process causes the signal intensities of GM and WM to become nearly identical in both T1-weighted and T2-weighted scans. This "isointense" effect results in extremely low tissue contrast, making traditional segmentation methods (like atlas-based or clustering approaches) highly inaccurate. This paper reviews how deep learning (DL) has emerged as the dominant solution to this specific "black box" period of neuroimaging.

Methods

The authors categorize deep learning approaches into two main evolutionary branches:

  1. Patch-based 2D CNNs: Early methods used sliding windows to extract 2D patches around a pixel to predict its label. While effective at handling small datasets, they are computationally redundant and ignore 3D spatial context.
  2. Fully Convolutional Networks (FCNs): The current gold standard. These are end-to-end models that take an entire image (or large 3D sub-volume) and output a full segmentation map.
  3. 2D FCNs (e.g., U-Net): Efficient but lose inter-slice connectivity.
  4. 3D FCNs: These capture the full volumetric context of the brain, which is vital for identifying structures when local contrast is poor.
  5. Advanced Architectures: The paper highlights 3D-DenseSeg (using dense connections for feature reuse) and SemiDenseNet (which connects all convolutional layers to the final classifier) as top-performing models that maximize information flow.

Datasets

The primary benchmark discussed is the iSeg-2017 (Infant Brain MRI Segmentation) dataset, which contains 6-month-old infant scans.

  • Training/Testing: Typically involves 10 labeled training subjects and 13 testing subjects.
  • Modalities: Most models utilize multi-modal input, combining T1-weighted and T2-weighted images. Some also incorporate Fractional Anisotropy (FA) from Diffusion Tensor Imaging to provide structural cues that intensity scans lack.
  • Pre-training: Some studies use the IBIS (Infant Brain Imaging Study) dataset for transfer learning.

Key Insights and Ideas

  • Multi-modality is Mandatory: Because GM and WM look the same in one modality during this stage, the "aha moment" for researchers was realizing that the relationship between T1 and T2 (and sometimes DTI) provides the necessary discriminative power.
  • Feature Reuse via Dense Connections: In the isointense phase, subtle features are easily lost. Architectures like DenseNet are particularly effective because they preserve low-level structural features through the network, preventing "gradient vanishing" and ensuring the model doesn't lose track of thin tissue boundaries.
  • The Power of 3D Context: 3D sub-volumes allow the network to "see" the continuity of the cortical ribbon across slices, which helps the model make a more informed guess when a specific 2D view is ambiguous.
  • Transfer Learning: Since labeled infant data is scarce, pre-training a model on adult brain data or other infant datasets significantly boosts performance on the small iSeg-2017 cohort.

Key Results

The review compares several top models on the iSeg-2017 dataset using the Dice Coefficient (DICE), where 1.0 is a perfect match:

  • CSF Segmentation: Generally the easiest, with most DL models achieving DICE scores > 95%.
  • GM and WM Segmentation: These are the real challenges. Top-tier models like 3D-DenseSeg and SemiDenseNet achieve DICE scores between 90% and 92%.
  • Comparison: DL methods significantly outperform traditional methods (like the M-CRIB atlas), which often struggle to break the 80% accuracy barrier for GM/WM during the isointense phase.

Limitations and Future Work

  • Data Scarcity: Manual labeling of infant brains is incredibly time-consuming and requires expert neuroanatomists. The authors suggest semi-supervised or weakly supervised learning (using unlabeled data) as a critical next step.
  • Lack of Anatomical Constraints: Current CNNs are "pixel-wise" and can sometimes produce anatomically impossible results (e.g., a hole in the middle of the white matter). Future work should incorporate anatomical priors, such as cortical thickness constraints or topological loss functions.
  • Data Augmentation: Using GANs (Generative Adversarial Networks) to synthesize realistic "isointense" training data could help train more robust models without needing more manual labels.

Summary updated

Abstract

磁共振(magnetic resonance,MR)成像作为一种安全非侵入式的成像技术,可以提供高分辨率且具有不同对比度的大脑图像,被越来越多地应用于婴儿大脑研究中。将婴儿脑MR图像准确地分割为灰质、白质和脑脊液,是研究早期大脑发育模式不可或缺的基础处理环节。由于在等强度阶段(6~9月龄)婴儿脑MR图像中,灰质和白质信号强度基本一致,组织对比度极低,导致此阶段的脑组织分割非常具有挑战性。基于深度学习的等强度婴儿脑MR图像分割方法,由于其卓越的性能受到研究人员的广泛关注,但目前尚未有文献对该领域的方法进行系统总结和分析。因此本文对目前基于深度学习的等强度婴儿脑MR图像分割方法进行了系统总结,从基本思想、网络架构、性能及优缺点4个方面进行了介绍。并针对其中的典型算法在iSeg-2017数据集上的分割结果进行了对比分析,最后对等强度婴儿脑MR图像分割中存在的问题及未来研究方向进行展望。本文通过对目前基于深度学习的等强度婴儿脑MR图像分割方法进行总结,可以看出深度学习方法已经在等强度期婴儿脑分割中展现出巨大优势,相比传统方法在分割精度和效率上均有较大提升,将进一步促进人类人脑早期发育研究。
BibTeX
@article{zhang2020review,
  author = {Hang Zhang and Yaping Wang and Xiujuan Geng and Pengfei Fu},
  title = {{Review of deep learning methods for isointense infant brain MR image segmentation}},
  journal = {Journal of Image and Graphics},
  year = {2020},
  doi = {10.11834/jig.200285},
}
Figure