Holistic segmentation of the lung in cine MRI

William Kovacs, Nathan Hsieh, Holger R. RothJournal of Medical Imaging 2017 · DOI

TL;DR

This paper introduces a novel deep learning approach, a holistically nested network (HNN), for segmenting lung regions in low-resolution cine MRI scans. This method significantly improves upon traditional registration-based techniques, enabling more accurate and efficient analysis of respiratory muscle function, crucial for diagnosing and tracking conditions like Duchenne muscular dystrophy (DMD).

What Problem Does This Paper Address?

Duchenne muscular dystrophy (DMD) is a progressive neuromuscular disease that severely impacts respiratory muscles, leading to life-threatening conditions like pneumonia and respiratory failure. Accurately tracking the progression of DMD in the lungs is challenging because existing methods, such as spirometry, provide only general insights into respiratory muscle function and cannot differentiate between specific muscle groups. While cine MRI offers a way to visualize lung and respiratory muscle movement throughout the breathing cycle without the risks of ionizing radiation, these scans suffer from low spatial resolution and poor signal-to-noise ratios. This makes manual segmentation tedious and automated methods prone to errors, hindering detailed analysis of lung mechanics. The paper aims to address this by developing a robust and accurate method for segmenting lung regions in these challenging cine MRI sequences.

Methods

The authors propose a deep learning-based approach using a Holistically Nested Network (HNN). This architecture, originally developed for edge detection, is adapted for image-to-image segmentation. A key innovation is its ability to leverage "sequence-specific prior information" by training the model on a single manually segmented slice from a cine MRI sequence and then applying it to segment the entire sequence (often hundreds of frames). This approach utilizes "deeply supervised nets" with multiple side-output layers that generate intermediate segmentation results at different stages of the network. These side outputs are then fused to produce a final, more accurate segmentation. The HNN model is pre-trained on ImageNet and then fine-tuned on their specific dataset. For comparison, they also implement a traditional registration-based method using the Demon's registration algorithm, which relies on manually segmenting an initial "atlas" slice and then registering it to subsequent slices.

Datasets

The study utilized cine MRI scans from 31 young boys (average age 9.6 ± 2.3 years), with 15 diagnosed with DMD and 16 healthy age-matched volunteers. Scans were acquired using Siemens MAGNETOM Aera and Avanto 1.5T MR scanners. The data included scans in axial, sagittal, and coronal planes, acquired during both normal and deep breathing. For training the HNN, one manually segmented slice per sequence and plane was used. The remaining slices formed the testing sets. Manual segmentations by two independent observers were also performed for validation, serving as the gold standard.

Key Insights and Ideas

  • Leveraging Sequence-Specific Priors: The core idea of using a single manually segmented slice to guide the segmentation of an entire cine MRI sequence is a clever way to overcome the data scarcity often encountered in medical imaging while still benefiting from the temporal information within a sequence.
  • HNN for Robust Segmentation: The HNN architecture's ability to capture multi-scale information and its "holistic" approach proved effective in handling the low spatial resolution and artifacts common in cine MRI, leading to smoother and more accurate lung boundaries compared to traditional methods.
  • Deep Learning's Efficacy Despite Data Limitations: The paper demonstrates that even with limited patient-specific data (one slice per sequence for training), deep learning can achieve superior results, highlighting its potential in medical imaging where large, annotated datasets are difficult to obtain.
  • Quantitative Link to Clinical Relevance: The ability to accurately segment lung movements directly enables the quantification of crucial lung characteristic measurements (like diaphragm movement area and chest wall movement area), which are vital for assessing disease progression and informing clinical decisions.

Key Results

The HNN-based method demonstrated superior performance compared to the registration-based approach. Quantitatively, the Dice similarity coefficients were:

  • Sagittal: 97.2 ± 1.3%
  • Axial: 96.1 ± 3.8%
  • Coronal: 96.6 ± 1.7%

These values were significantly higher than those achieved by the registration method, indicating a much better agreement with manual segmentations. The HNN also showed a lower average and maximum distance error. Qualitatively, the HNN produced smoother lung boundaries, particularly in the sagittal plane, and was less susceptible to artifacts and motion-induced distortions that plagued the registration method. The study also found that for axial and coronal planes, segmentations including the heart performed better with the HNN than without, suggesting the network could effectively learn to differentiate lung from heart tissue.

Limitations and Future Work

The authors acknowledge that while the HNN method is robust, the transition from manual segmentation to fully automated segmentation might require a gradual approach, potentially involving fine-tuning models or developing models that can adapt to new datasets with minimal human intervention. They also note that the voluntary nature of breathing can introduce variability, making it challenging to derive perfectly consistent breathing patterns. Future work could focus on further refining the HNN architecture, exploring its application to other dynamic imaging modalities, and developing more sophisticated methods for deriving clinical insights from the segmented data. The paper also suggests that as more data becomes available, the deep learning model will become even more robust.

Summary updated

Abstract

Duchenne muscular dystrophy (DMD) is a childhood-onset neuromuscular disease that results in the degeneration of muscle, starting in the extremities, before progressing to more vital areas, such as the lungs. Respiratory failure and pneumonia due to respiratory muscle weakness lead to hospitalization and early mortality. However, tracking the disease in this region can be difficult, as current methods are based on breathing tests and are incapable of distinguishing between muscle involvements. Cine MRI scans give insight into respiratory muscle movements, but the images suffer due to low spatial resolution and poor signal-to-noise ratio. Thus, a robust lung segmentation method is required for accurate analysis of the lung and respiratory muscle movement. We deployed a deep learning approach that utilizes sequence-specific prior information to assist the segmentation of lung in cine MRI. More specifically, we adopt a holistically nested network to conduct image-to-image holistic training and prediction. One frame of the cine MRI is used in the training and applied to the remainder of the sequence ([Formula: see text] frames). We applied this method to cine MRIs of the lung in the axial, sagittal, and coronal planes. Characteristic lung motion patterns during the breathing cycle were then derived from the segmentations and used for diagnosis. Our data set consisted of 31 young boys, age [Formula: see text] years, 15 of whom suffered from DMD. The remaining 16 subjects were age-matched healthy volunteers. For validation, slices from inspiratory and expiratory cycles were manually segmented and compared with results obtained from our method. The Dice similarity coefficient for the deep learning-based method was [Formula: see text] for the sagittal view, [Formula: see text] for the axial view, and [Formula: see text] for the coronal view. The holistic neural network approach was compared with an approach using Demon's registration and showed superior performance. These results suggest that the deep learning-based method reliably and accurately segments the lung across the breathing cycle.
BibTeX
@article{kovacs2017holistic,
  author = {William Kovacs and Nathan Hsieh and Holger R. Roth},
  title = {{Holistic segmentation of the lung in cine MRI}},
  journal = {Journal of Medical Imaging},
  year = {2017},
  doi = {10.1117/1.jmi.4.4.041310},
}
Figure