DSU-net: Dense SegU-net for automatic head-and-neck tumor segmentation in MR images

Luping ZhouarXiv 2020 · arXiv

TL;DR

This paper introduces DSU-net, a novel deep learning architecture for automatically segmenting nasopharyngeal carcinoma (NPC) in MRI scans. By combining the strengths of SegNet's unpooling for better boundary preservation and DenseNet's efficient feature reuse, DSU-net achieves state-of-the-art accuracy while reducing model complexity and computational cost.

What Problem Does This Paper Address?

Accurate segmentation of head-and-neck tumors, particularly nasopharyngeal carcinoma (NPC), is crucial for effective treatment planning and monitoring. However, segmenting NPC in MRI is challenging due to several factors:

  • Boundary Ambiguity: NPC often infiltrates surrounding tissues, making its exact boundaries difficult to discern.
  • Variability: Tumors can vary significantly in size and shape across patients.
  • Manual Segmentation Limitations: Current manual segmentation by oncologists is time-consuming, labor-intensive, and prone to inter- and intra-observer variability, leading to potential inconsistencies in treatment.

Existing deep learning methods, while promising, still struggle with these challenges, particularly in preserving fine boundary details and efficiently handling complex feature representations.

Methods

The proposed DSU-net builds upon existing U-net architectures but incorporates several key innovations:

  • SegU-net Foundation: The architecture starts with a SegU-net, which replaces the traditional upconvolutional layers in the decoder with unpooling. Unpooling, borrowed from SegNet, uses pooling indices from the encoder to reconstruct feature maps, preserving localization information and improving boundary detail preservation compared to upconvolution.
  • Dense Blocks for Efficiency: To combat the potential vanishing-gradient problem and enhance feature propagation and reuse, DSU-net replaces standard convolutional blocks with dense blocks, inspired by DenseNet. In dense blocks, each layer receives feature maps from all preceding layers within the block, promoting feature reuse and significantly reducing the number of parameters.
  • Composite Loss Function: The authors propose a combined loss function consisting of Cross-Entropy (CE) loss and Dice loss. This hybrid approach aims to address the class imbalance issue (where tumor regions are small) and improve optimization stability, which can be a problem with Dice loss alone.
  • Optimized Architecture: The DSU-net architecture consists of an encoder for feature extraction and a decoder for segmentation. It incorporates a specific block for pooling and unpooling to separate the encoder and decoder. The dense blocks are strategically placed in both the feature extraction and upsampling paths.

Datasets

The study utilized T1-weighted MRI scans from 95 NPC patients treated at West China Hospital.

  • Training Set: 60 patients
  • Cross-validation Set: 15 patients
  • Test Set: 20 patients

The dataset was augmented through rotation, translation, and flipping, increasing the effective training set size to 8,140 slices of 128x128 pixels. The region of interest (ROI) was cropped to 128x128 from each MRI slice for computational efficiency.

Key Insights and Ideas

  • Unpooling is Key for Boundaries: The paper strongly demonstrates that unpooling, by leveraging encoder pooling indices, is superior to upconvolution for preserving fine boundary details in medical image segmentation, especially for challenging structures like NPC.
  • Dense Blocks for Parameter Efficiency: Integrating dense blocks significantly reduces the model's parameter count while enhancing feature learning. This is crucial for preventing overfitting, especially with limited training data.
  • Hybrid Loss for Robustness: The combination of CE and Dice loss proves more effective than either alone for segmenting imbalanced datasets like NPC MRI, leading to better optimization and segmentation accuracy.
  • DSU-net Outperforms SegU-net: The dense connections in DSU-net not only reduce parameters but also improve segmentation performance over the SegU-net baseline, highlighting the synergistic effect of dense blocks and unpooling.

Key Results

  • State-of-the-Art Performance: DSU-net achieved the best results across all evaluation metrics (DSC, PM, CR, ASSD) when compared to SegNet, DeepLab (ResNet/Xception), and SegU-net.
  • Improved DSC: The average Dice Similarity Coefficient (DSC) for DSU-net was 0.8003, outperforming SegU-net (0.7953) and other methods.
  • Reduced Parameters: DSU-net significantly reduced the number of parameters by 80% compared to SegU-net, making it more efficient.
  • Visual Improvements: Qualitative results showed DSU-net providing more accurate segmentation, particularly in delineating tumor boundaries, with less over- and under-segmentation compared to other methods.

Limitations and Future Work

The authors acknowledge the following limitations and suggest future research directions:

  • Limited Training Data: The current dataset size is a limitation. Future work will involve acquiring more MRI data to improve the model's generalization ability.
  • 2D Segmentation: The current model operates on 2D slices, neglecting valuable 3D spatial information. Future research will focus on developing 3D deep networks to leverage this information.
  • Single Modality: The study focuses solely on MRI. Future work will explore multi-modality segmentation approaches to combine information from different imaging techniques.
  • Further Improvement: While DSU-net shows significant improvement, further enhancements to segmentation performance are still being explored. The authors also plan to investigate the network's potential for general image semantic segmentation tasks.

Summary updated

Abstract

Precise and accurate segmentation of the most common head-and-neck tumor, nasopharyngeal carcinoma (NPC), in MRI sheds light on treatment and regulatory decisions making. However, the large variations in the lesion size and shape of NPC, boundary ambiguity, as well as the limited available annotated samples conspire NPC segmentation in MRI towards a challenging task. In this paper, we propose a Dense SegU-net (DSU-net) framework for automatic NPC segmentation in MRI. Our contribution is threefold. First, different from the traditional decoder in U-net using upconvolution for upsamling, we argue that the restoration from low resolution features to high resolution output should be capable of preserving information significant for precise boundary localization. Hence, we use unpooling to unsample and propose SegU-net. Second, to combat the potential vanishing-gradient problem, we introduce dense blocks which can facilitate feature propagation and reuse. Third, using only cross entropy (CE) as loss function may bring about troubles such as miss-prediction, therefore we propose to use a loss function comprised of both CE loss and Dice loss to train the network. Quantitative and qualitative comparisons are carried out extensively on in-house datasets, the experimental results show that our proposed architecture outperforms the existing state-of-the-art segmentation networks.
BibTeX
@misc{zhou2020dsu,
  author = {Luping Zhou},
  title = {{DSU-net: Dense SegU-net for automatic head-and-neck tumor segmentation in MR images}},
  year = {2020},
  eprint = {2006.06278},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2006.06278},
}
Figure