DECOR-Net: A Covid-19 Lung Infection Segmentation Network Improved by Emphasizing Low-Level Features and Decorrelating Features

Jiesi Hu, Yanwu Yang, Xutao Guo, Bo Peng, Hua Huang, Ting Ma

TL;DR

This paper introduces DECOR-Net, a novel deep learning architecture for segmenting COVID-19 infections in CT scans. By emphasizing low-level features like texture and intensity through channel re-weighting and a new decorrelation loss, DECOR-Net achieves state-of-the-art performance, outperforming existing methods.

What Problem Does This Paper Address?

Accurately segmenting COVID-19 infections in CT scans is crucial for diagnosis and monitoring disease progression. However, these infections often present with high heterogeneity, unclear boundaries, and varied patterns, making them difficult to distinguish. While deep learning models like U-Net have shown promise, they often struggle to effectively capture the subtle, low-level features (texture, intensity) that are critical for identifying these challenging infections. Existing methods that focus on edge or shape information may be limited by the inherent blurriness of infection boundaries. This paper aims to bridge this gap by proposing a network specifically designed to better capture and leverage diverse low-level features.

Methods

DECOR-Net builds upon the Res-UNet architecture, introducing two key innovations:

  • Channel Re-weighting Strategy: To enhance the network's ability to perceive low-level features, the number of channels in the shallow layers of the network is significantly increased. To maintain a consistent parameter count, the number of channels in deeper layers is reduced accordingly. This effectively shifts representational capacity towards capturing more detailed, low-level information. The channel configuration is changed from the standard (32, 64, 128, 256, 512) to (248, 248, 112, 112, 112) for the encoder units.
  • Decorrelation Loss (Decor Loss): After increasing the number of channels, there's a risk of redundancy in learned low-level features. To address this, a novel decorrelation loss is proposed. This loss function aims to reduce the correlation between different feature channels in the output feature maps. It works by calculating a channel correlation map, applying a softmax to obtain a probability map, and then using a cross-entropy loss that encourages channels to be more independent of each other. This loss is added to the standard segmentation loss (binary cross-entropy and Dice loss).

Datasets

The primary dataset used for training and evaluation is the COVID-19 Challenge dataset. This dataset contains 199 lung CT volumes from COVID-19 patients, comprising 9704 CT slices of 512x512 resolution. The data is split into 127 volumes for training, 32 for validation, and 40 for testing.

Key Insights and Ideas

  • Low-level features are paramount: The paper strongly emphasizes that for challenging segmentation tasks like COVID-19 infections, focusing on low-level features (texture, intensity) is more critical than relying solely on high-level semantic information or edge/shape cues, especially given the blurred boundaries.
  • Channel re-weighting is effective for feature enhancement: By strategically reallocating channels from deeper to shallower layers, the network's capacity to capture fine-grained details is significantly boosted.
  • Decorrelation loss prevents feature redundancy: Simply increasing channels can lead to similar features being learned. The proposed decorrelation loss effectively encourages diversity among these low-level features, making them more discriminative.
  • Decorrelation loss is robust: The paper demonstrates that the decorrelation loss consistently improves performance across different channel settings, highlighting its general applicability.

Key Results

  • DECOR-Net achieved state-of-the-art performance on the COVID-19 Challenge dataset, outperforming other cutting-edge methods.
  • Compared to a baseline (presumably Res-UNet with channel re-weighting but without decorrelation loss), DECOR-Net surpassed it by 5.1% in Dice coefficient and 4.9% in Intersection over Union (IoU).
  • The proposed decorrelation loss consistently improved performance across various channel configurations, as shown in Figure 5.
  • The model size is comparable to existing methods, with DECOR-Net having 6.457 million parameters, which is relatively small compared to some other advanced models.

Limitations and Future Work

  • Limitations: The paper does not explicitly discuss limitations of the proposed method in terms of computational cost or potential failure cases. The decorrelation loss parameter ($\lambda$) was set to 0.01 after hyperparameter tuning, suggesting that its optimal value might vary.
  • Future Work: The authors suggest that the DECOR-Net architecture, with its emphasis on low-level features and decorrelation, may be widely applicable to other lesion segmentation tasks that rely heavily on texture or edge information. Further exploration into applying this approach to different medical imaging modalities or disease types could be a promising direction.

Summary updated

Abstract

Since 2019, coronavirus Disease 2019 (COVID-19) has been widely spread and seriously threatened public health. Chest Computed Tomography (CT) holds great potential for screening and diagnosis of this disease. The segmentation of COVID-19 CT imaging can achieve a quantitative evaluation of infections and track disease progression. COVID-19 infections are characterized by high heterogeneity and unclear boundaries, so capturing low-level features such as texture and intensity is critical for segmentation. However, most existing segmentation models potentially overlook this feature. In this work, we propose a DECOR-Net capable of perceiving more diverse low-level features. The channel re-weighting strategy is applied to balance high-level and low-level features and the dependencies between channels are reduced by proposed decorrelation loss. Experiments show that DECOR-Net outperforms other cutting-edge methods and surpasses the baseline by 4.8% and 4.7% in terms of Dice coefficient and intersection over union. Moreover, the proposed decorrelation loss can constantly improve performance under different settings. The Code is available at https://github.com/jiesihu/DECOR-Net.git.
BibTeX
@inproceedings{hu2023decor,
  author = {Jiesi Hu and Yanwu Yang and Xutao Guo and Bo Peng and Hua Huang and Ting Ma},
  title = {{DECOR-Net: A Covid-19 Lung Infection Segmentation Network Improved by Emphasizing Low-Level Features and Decorrelating Features}},
  booktitle = {ISBI},
  year = {2023},
  url = {https://openreview.net/forum?id=4FhOcCNweK},
}
Figure