R2U3D: Recurrent Residual 3D U-Net for Lung Segmentation

Dhaval D. Kadia, Md. Zahangir Alom, Ranga Burada, Tam V. Nguyen, Vijayan K. Asari

Introduction

Accurate 3D lung segmentation is a foundational step in medical imaging pipelines, particularly for diagnosing conditions such as lung cancer, pulmonary embolisms, and viral infections like COVID-19. By isolating lung tissue from the surrounding thoracic structures in volumetric CT scans, clinicians can better analyze pathologies. However, the task is challenging due to the irregular geometry of the lungs, low contrast at tissue boundaries, and the presence of high-attenuation patterns in diseased states.

While 2D deep learning models have shown promise, they often fail to capture the critical "inter-slice" spatial dependencies inherent in 3D volumes. Conversely, standard 3D models are often computationally intensive and require vast amounts of labeled data. To address these issues, the authors propose the Recurrent Residual 3D U-Net (R2U3D), a novel architecture designed for high-precision segmentation with superior data efficiency.

The R2U3D Architecture

The R2U3D model builds upon the established U-Net framework, integrating 3D convolutions with advanced architectural components to enhance feature propagation and spatial learning.

The R2U3D architecture overview, featuring the encoder-decoder structure and specialized downsampling modules.

Key innovations in the R2U3D include:

  • Recurrent Residual Convolutional Units (RRCU): These units replace standard convolutions, utilizing a recurrent mechanism to refine feature maps over multiple iterations. This "looping" allows the network to accumulate spatial information and improve feature representation without a massive increase in parameters.
  • Inception-like Downsampling: Instead of simple max-pooling, the encoder employs a multi-scale downsampling network. This module uses parallel convolutions with varying kernel sizes (1x1x1, 3x3x3, and 5x5x5) to capture diverse local and global context from the raw CT data.
  • Squeeze-and-Excitation (SE) Blocks: Integrated into the network, SE blocks provide channel-wise attention, allowing the model to prioritize informative feature maps while suppressing noise.

Recurrent Residual Convolutional Units (RRCU)

The RRCU is the heart of the R2U3D's ability to learn complex spatial dependencies. By unrolling the recurrence, the unit effectively acts as a deep stack of shared-weight layers with residual connections, facilitating better gradient flow and feature refinement.

Detailed view of the Recurrent Residual Convolutional Unit (RRCU) showing the feature accumulation process.

To further optimize performance, the authors implemented Dynamic Recurrence (DRRCU). In this configuration, the depth of recurrence varies across the "U" shape: shallower recurrence is used at high-resolution layers to save memory, while deeper recurrence is applied at the bottleneck where features are most abstract.

Experimental Results

The R2U3D was evaluated on the LUNA16 and VESSEL12 datasets. A standout finding of the study was the model's extreme data efficiency. When trained on only 100 scans from the LUNA16 dataset—without any data augmentation—the R2U3D achieved a Soft Dice Similarity Coefficient (Soft-DSC) of 0.9920.

On the VESSEL12 benchmark, the Dynamic R2U3D outperformed the Extended V-Net (0.987 Soft-DSC) despite being trained on significantly less data. On the full LUNA16 test set of 176 scans, the model maintained a high performance of 0.9859 Soft-DSC. Qualitative analysis confirmed that the model produces smooth, anatomically consistent segmentations, even at difficult boundaries like the diaphragm and chest wall.

Limitations and Future Outlook

While the R2U3D demonstrates state-of-the-art performance on standard benchmarks, challenges remain when dealing with heavily infected lungs. In cases of COVID-19, "Ground-Glass Opacities" (GGO) can alter the lung's appearance to resemble solid tissue, leading to segmentation drops.

Future research will focus on:

  • Robustness to Infection: Utilizing Generative Adversarial Networks (GANs) to synthesize infected lung data for more robust training.
  • Clinical Integration: Adapting the model for automated nodule classification and quantifying the severity of lung infections to assist in clinical decision-making.

Summary updated

Abstract

3D lung segmentation is essential since it processes the volumetric information of the lungs, removes the unnecessary areas of the scan, and segments the actual area of the lungs in a 3D volume. Recently, the deep learning model, such as U-Net outperforms other network architectures for biomedical image segmentation. In this paper, we propose a novel model, namely, Recurrent Residual 3D U-Net (R2U3D), for the 3D lung segmentation task. In particular, the proposed model integrates 3D convolution into the Recurrent Residual Neural Network based on U-Net. It helps learn spatial dependencies in 3D and increases the propagation of 3D volumetric information. The proposed R2U3D network is trained on the publicly available dataset LUNA16 and it achieves state-of-the-art performance on both LUNA16 (testing set) and VESSEL12 dataset. In addition, we show that training the R2U3D model with a smaller number of CT scans, i.e., 100 scans, without applying data augmentation achieves an outstanding result in terms of Soft Dice Similarity Coefficient (Soft-DSC) of 0.9920.
BibTeX
@inproceedings{kadia2021r,
  author = {Dhaval D. Kadia and Md. Zahangir Alom and Ranga Burada and Tam V. Nguyen and Vijayan K. Asari},
  title = {{R2U3D: Recurrent Residual 3D U-Net for Lung Segmentation}},
  booktitle = {IEEE Access},
  year = {2021},
  url = {https://openreview.net/forum?id=f1zlazoNPJu},
}
Figure