BiSC-UNet: A fine segmentation framework for kidney and renal tumor

Chuanxia Wang, Yuting He, Xiaoming Qi, Ziteng Zhao, Guanyu Yang, Xiaomei Zhu, Shaobo Zhang, Jean‐Louis Dillenseger, Jean-Louis Coatrieux2019 · DOI

TL;DR

This paper introduces BiSC-UNet, a novel two-stage deep learning framework for automatically segmenting kidneys and renal tumors in CT scans. By first roughly locating the kidney region and then performing fine segmentation within that region, BiSC-UNet achieves improved accuracy, particularly for challenging cases.

What Problem Does This Paper Address?

Accurate segmentation of kidneys and renal tumors from CT scans is crucial for surgical planning, especially for minimally invasive procedures like partial nephrectomy. Manual segmentation is time-consuming and prone to errors. Existing automated methods struggle with the variability in tumor size, shape, and location, as well as the significant class imbalance between the small tumor/kidney regions and the large background in CT images. This paper aims to address these challenges by proposing a more robust and accurate automated segmentation framework.

Methods

The core of the proposed solution is the BiSC-UNet, a framework composed of two cascaded SC-UNet modules.

  • SC-UNet (Structural Constraint UNet): This is the building block. It's a 3D U-Net architecture enhanced to incorporate both contextual and shape information. It achieves this by using three parallel branches in its up-sampling path: one for the kidney and tumor segmentation, one for the kidney edge, and one for the tumor edge. These edge maps are generated using the Canny edge detection algorithm. This multi-branch approach allows the network to learn not just the overall structure but also the precise boundaries of the kidney and tumor.
  • BiSC-UNet (Bi-stage SC-UNet): This framework leverages two SC-UNets in sequence:
  • Rough SC-UNet: Takes the original CT image as input and performs a coarse segmentation to identify the kidney and tumor. This output is then used to extract a Region of Interest (ROI) containing the kidney. This step helps to balance the background and reduce computational load for the next stage.
  • Fine SC-UNet: Takes the cropped kidney ROI (at original resolution) as input and performs a detailed, fine-grained segmentation of the kidney and renal tumor within this localized area.

To address the issue of category imbalance (where tumors and kidneys are small compared to the background), the authors propose a balanced cross-entropy loss function. This loss function dynamically weights different regions and categories based on their size, giving more importance to smaller, harder-to-segment regions like tumors.

Datasets

The experiments were conducted using the KiTS19 challenge dataset. This dataset contains 210 training cases with associated segmentation masks for kidneys and renal tumors. For their experiments, the authors used 168 cases for training and 42 for testing. Data augmentation techniques like random cropping and mirroring were applied.

Key Insights and Ideas

  • Two-stage segmentation is effective: The paper demonstrates that a coarse-to-fine approach significantly improves segmentation accuracy. By first localizing the kidney region, the subsequent fine segmentation can focus its resources more effectively, leading to better results.
  • Shape matters, especially edges: Incorporating edge information (kidney and tumor boundaries) directly into the SC-UNet architecture is a key innovation. This explicit focus on shape constraints helps the network learn more precise segmentations, particularly for irregular tumor shapes.
  • Balanced loss for imbalanced data: The proposed balanced cross-entropy loss is crucial for handling the inherent class imbalance in medical imaging datasets. Dynamically weighting categories based on size helps the model learn from small but critical structures like tumors.

Key Results

  • Improved Dice Coefficients: The BiSC-UNet with the balanced cross-entropy loss achieved improved Dice coefficients compared to using a standard cross-entropy loss. Specifically, it increased the Dice coefficient for kidneys by 0.012 (from 0.942 to 0.954) and for tumors by 0.005 (from 0.736 to 0.741).
  • Visual Superiority: Qualitative results show that the BiSC-UNet produces smooth edges and accurately segments tumors of varying sizes. The paper highlights a specific case where a tumor missed by the rough segmentation was successfully identified by the fine segmentation stage, showcasing the benefit of the cascade structure.

Limitations and Future Work

  • Computational Cost: While the two-stage approach helps manage computational load, deep learning models for 3D medical image segmentation can still be computationally intensive.
  • Generalizability: The performance is evaluated on the KiTS19 dataset. Further validation on diverse datasets with varying scanner protocols and patient populations would be beneficial.
  • Future Work: The paper implicitly suggests that further exploration of shape-aware features and more sophisticated loss functions for imbalanced data could lead to even greater improvements. The authors also mention that their framework combines contextual and shape information, hinting at potential for further research in balancing these aspects.

Summary updated

Abstract

Computed tomography (CT) images can provide a view of the patients' internal organs. This property is particular conducive to surgery planning. As one of the most common cancers, renal cancer also can be treated effectively by the laparo-scopic partial nephrectomy (LPN). However, automatic and accurate kidney and renal tumor segmentation in CT images remains a challenge. In this paper, BiSC-UNet framework which combines two different resolution SC-UNets is proposed for kidney and renal tumor fine segmentation. Rough SC-UNet is in charge of locating the kidney and renal tumor roughly to achieve the kidney region of interest (ROI) in original CT images. The other fine SC-UNet utilizes the kidney ROI for final fine kidney and renal tumor segmentation. In the proposed SC-UNet, not only the labeled kidney and renal tumor are used for training, but also the labeled renal tumor edge and kidney edge are utilized for accurate segmentation result. A balanced cross-entropy which selects and dynamic weights different regions and categorys is proposed for category imbalance. Extensive experiments on CT datasets demonstrate the effectiveness of proposed network.
BibTeX
@misc{wang2019bisc,
  author = {Chuanxia Wang and Yuting He and Xiaoming Qi and Ziteng Zhao and Guanyu Yang and Xiaomei Zhu and Shaobo Zhang and Jean‐Louis Dillenseger and Jean-Louis Coatrieux},
  title = {{BiSC-UNet: A fine segmentation framework for kidney and renal tumor}},
  year = {2019},
  doi = {10.24926/548719.013},
}
Figure