Automatic biometry of fetal brain MRIs using deep and machine learning techniques

Jiayan She, Haiying Huang, Zhijun Ye, Huang Wei, Yan Sun, Chuan Liu, Weilin Yang, Jiaxi Wang, Pengfei Ye, Lei Zhang, Gang NingScientific 2023 · DOI

TL;DR

Researchers have developed a robust, two-step automated pipeline that uses deep learning (nnU-Net) and geometric machine learning to perform fetal brain biometry on MRI scans. The system achieves human-level accuracy across multiple scanner types and field strengths, potentially transforming a laborious, expert-dependent clinical task into a fast, reproducible workflow.

What Problem Does This Paper Address?

Assessing fetal brain development is a cornerstone of prenatal care, helping clinicians determine gestational age (GA), estimate fetal weight, and detect central nervous system malformations. Currently, this relies on 2D linear measurements—like the cerebral biparietal diameter (CBPD) and transcerebellar diameter (TCD)—captured manually by radiologists from MRI slices.

This manual process has three major pain points:

  1. Labor Intensity: It is time-consuming and requires highly specialized expertise.
  2. Variability: Measurements often differ between different radiologists (inter-observer) or even the same radiologist at different times (intra-observer).
  3. Slice Selection Bias: Radiologists must manually find the "perfect" slice to measure, which can be subjective and prone to error.

Methods

The authors proposed a hybrid approach that combines deep learning for "vision" and traditional machine learning algorithms for "measurement logic."

  1. Step 1: Deep Learning Segmentation: The team used nnU-Net, a self-configuring framework that is currently the state-of-the-art for medical image segmentation. The model was trained to partition the fetal brain into four distinct regions: the cerebrum, cerebellum, and the left and right lateral ventricles.
  2. Step 2: Geometric Machine Learning: Once the regions were segmented, the system applied geometric rules based on clinical guidelines to calculate biometrics:
  3. CBPD & TCD: The algorithm finds the maximal bounding rectangle for the segmented masks across all slices and calculates distances perpendicular to the brain's main orientation.
  4. LAD & RAD (Atrial Diameters): The system uses a template to locate the specific slice at the level of the atria and measures the internal diameter of the ventricles.

By segmenting the entire brain volume rather than just a few slices, the algorithm can iterate through every slice to find the true maximum diameter, a feat that is too time-consuming for humans to do manually.

Datasets

The study utilized a retrospective dataset of 268 fetal MRI volumes (totaling 5,360 images) from normal fetuses.

  • Diversity: Data came from two different manufacturers and field strengths: a Siemens MAGNETOM Skyra 3.0T and a Philips Achieva 1.5T.
  • Annotation: Four professional radiologists provided the "ground truth" manual delineations and measurements, which were then verified by a senior expert with over 30 years of experience.

Key Insights and Ideas

  • Volume vs. Slice: The most significant "aha" moment is the shift from slice-based to volume-based analysis. While previous attempts at automation required selecting a "reference slice" first, this method segments the whole brain. This allows the computer to find the absolute maximum diameter across the entire volume, making it more accurate and less prone to the "off-angle" errors common in manual 2D imaging.
  • Robustness Across Hardware: Because the dataset included both 1.5T and 3.0T scanners, the model demonstrated that it could handle varying signal-to-noise ratios and image qualities, making it more viable for real-world clinical deployment.
  • Growth Trajectory Modeling: The researchers didn't just stop at measurement; they used the automated data to map the growth trajectory of the fetal brain from 24 to 37 weeks, providing a high-resolution reference for what "normal" development looks like.

Key Results

The automated system showed excellent agreement with expert radiologists:

  • Correlation (R): The Pearson correlation coefficients were remarkably high for CBPD (0.977) and TCD (0.990). Atrial diameters (LAD/RAD) were slightly lower (0.817 and 0.719) but still statistically significant.
  • Mean Difference (MD): The average error was minimal. For TCD, the difference was a negligible -0.008 mm. For CBPD, it was -2.405 mm (likely due to the algorithm excluding the skull/fluid space that humans sometimes inadvertently include).
  • Segmentation Accuracy: The nnU-Net achieved a Dice Similarity Coefficient of 0.95 for the cerebrum, indicating nearly perfect overlap with manual expert tracings.

Limitations and Future Work

While promising, the study has a few hurdles to clear before widespread adoption:

  • "Normal" Bias: The model was only trained and tested on healthy fetal brains. Its performance on brains with significant malformations or tumors remains unknown.
  • Gestational Age Gaps: The dataset was sparse for very early ( < 23 weeks) and very late ( > 38 weeks) pregnancies, leading to less reliable results at those extremes.
  • Orientation Constraints: Currently, the tool focuses on coronal measurements. Future work is needed to automate measurements in other planes, such as head circumference (HC) in axial views or corpus callosum length in sagittal views.

Summary updated

Abstract

Abstract Linear biometric measurements on magnetic resonance images are important for the assessment of fetal brain development, which is expert knowledge dependent and laborious. This study aims to construct a segmentation-based method for automatic two-dimensional biometric measurements of fetal brain on magnetic resonance images that provides a fast and accurate measurement of fetal brain. A total of 268 volumes (5360 images) magnetic resonance images of normal fetuses were included. The automatic method involves two steps. First, the fetal brain was segmented into four parts with a deep segmentation network: cerebrum, cerebellum, and left and right lateral ventricles. Second, the measurement plane was determined, and the corresponding biometric parameters were calculated according to clinical guidelines, including cerebral biparietal diameter (CBPD), transverse cerebellar diameter (TCD), left and right atrial diameter (LAD/RAD). Pearson correlation coefficient and Bland–Altman plots were used to assess the correlation and agreement between computer-predicted values and manual measurements. Mean differences were used to evaluate the errors quantitatively. Analysis of fetal cerebral growth based on the automatic measurements was also displayed. The experiment results show that correlation coefficients for CBPD, TCD, LAD and RAD were as follows: 0.977, 0.990, 0.817, 0.719, mean differences were − 2.405 mm, − 0.008 mm, − 0.33 mm, − 0.213 mm, respectively. The correlation between the errors and gestational age was not statistically significant (p values were 0.2595, 0.0510, 0.1995, and 0.0609, respectively). The proposed automatic method for linear measurements on fetal brain MRI achieves excellent performance, which is expected to be applied in clinical practice and be helpful for prenatal diagnosis and clinical work efficiency improvement.
BibTeX
@inproceedings{she2023automatic,
  author = {Jiayan She and Haiying Huang and Zhijun Ye and Huang Wei and Yan Sun and Chuan Liu and Weilin Yang and Jiaxi Wang and Pengfei Ye and Lei Zhang and Gang Ning},
  title = {{Automatic biometry of fetal brain MRIs using deep and machine learning techniques}},
  booktitle = {Scientific},
  year = {2023},
  doi = {10.1038/s41598-023-43867-4},
}
Figure