MARes-Net: multi-scale attention residual network for jaw cyst image segmentation

Xiaokang Ding, Xiaoliang Jiang, Huixia Zheng, Hualuo Shi, Ban Wang, Sixian ChanFrontiers in Bioengineering and Biotechnology 2024 · DOI

TL;DR

MARes-Net is a novel deep-learning architecture designed to solve the "fuzzy boundary" problem in jaw cyst segmentation. By integrating residual connections with multi-scale attention modules (SFEM and MCEM), the network achieves a high F1-score of 93.21%, significantly outperforming standard U-Net and other state-of-the-art medical segmentation models.

What Problem Does This Paper Address?

Jaw cysts are fluid-filled lesions that can lead to facial swelling and bone fractures if not accurately diagnosed. While CT scans and X-rays are standard diagnostic tools, manual segmentation of these cysts is labor-intensive and prone to error.

From a computer vision perspective, jaw cysts present a unique challenge: they vary wildly in size and shape, and their boundaries often blend into surrounding anatomical structures. Existing deep-learning models, like the classic U-Net, often struggle with these multi-scale features and can suffer from "gradient disappearance" as the network depth increases, leading to loss of fine-grained detail in the final segmentation map.

Methods

The authors propose MARes-Net (Multi-scale Attention Residual Network), which builds on the U-Net backbone but introduces four critical enhancements:

  1. Residual Connections: Instead of standard convolutional blocks, the model uses residual learning. This allows gradients to flow more easily through the network, preventing the vanishing gradient problem and allowing for deeper, more efficient training.
  2. Scale-aware Feature Extraction Module (SFEM): This module uses atrous (dilated) convolutions with varying expansion rates (1, 3, and 5) combined with a Convolutional Block Attention Module (CBAM). This allows the network to expand its receptive field—essentially seeing the "big picture" and the "fine details" simultaneously without increasing the number of parameters.
  3. Multi-scale Compression Excitation Module (MCEM): Based on Squeeze-and-Excitation (SE) principles, this module adaptively weights the importance of different feature channels across multiple resolutions. It ensures that the most relevant contextual information is prioritized as data moves through the encoder-decoder process.
  4. Attention Gates (AG): Integrated into the up-sampling stage, these gates help the model selectively focus on salient regions (the cyst) while suppressing irrelevant background noise in the image.

Datasets

The study utilized a specialized dataset provided by Quzhou People’s Hospital:

  • Original Dataset: 1,535 images (922 for training, 307 for validation, and 306 for testing).
  • Augmented Dataset: To combat the common medical AI problem of small sample sizes, the authors used data augmentation (rotation, scaling, stretching) to expand the pool to 4,602 images.
  • Specifications: All images and labels were standardized to a $256 \times 256$ resolution.

Key Insights and Ideas

  • Synergy of Attention: The ablation studies revealed that combining spatial and channel attention (via CBAM in the SFEM) is significantly more effective than using either alone. It allows the model to "lock onto" the area of interest even when the contrast between the cyst and bone is low.
  • The Power of Multi-Scale: By processing features at multiple scales (via MCEM), the network avoids the "one-size-fits-all" approach of standard convolutions. This is particularly useful for jaw cysts, which can appear as tiny spots or large, invasive masses.
  • Residuals are Mandatory: The authors demonstrated that without residual connections, the segmentation maps often had "defects" or holes, proving that identity mapping is crucial for preserving structural integrity in medical imaging.

Key Results

MARes-Net demonstrated superior performance across all standard metrics on the original jaw cyst dataset:

  • Precision: 93.84%
  • Recall: 93.70%
  • Intersection over Union (IoU): 86.17%
  • F1-score: 93.21%

In comparative testing, MARes-Net outperformed seven other models, including HRNet, ICNet, and the standard U-Net. Specifically, it improved the IoU by 4.36% and the F1-score by 2.46% over the baseline U-Net.

Limitations and Future Work

While highly accurate, MARes-Net is computationally heavier than some "lite" models.

  • Efficiency: With 4.58 million parameters and a processing time of 200ms per step, it is slower and more memory-intensive than models like ICNet (1.71M parameters, 150ms/step).
  • Real-time Deployment: The authors acknowledge that future work must focus on optimizing the model for real-time clinical use, potentially through model pruning or quantization.
  • Generalization: The current study relies on data from a single hospital. Testing the architecture on more diverse, multi-center datasets would be a necessary next step to ensure its robustness across different imaging hardware and patient populations.

Summary updated

Abstract

Jaw cyst is a fluid-containing cystic lesion that can occur in any part of the jaw and cause facial swelling, dental lesions, jaw fractures, and other associated issues. Due to the diversity and complexity of jaw images, existing deep-learning methods still have challenges in segmentation. To this end, we propose MARes-Net, an innovative multi-scale attentional residual network architecture. Firstly, the residual connection is used to optimize the encoder-decoder process, which effectively solves the gradient disappearance problem and improves the training efficiency and optimization ability. Secondly, the scale-aware feature extraction module (SFEM) significantly enhances the network's perceptual abilities by extending its receptive field across various scales, spaces, and channel dimensions. Thirdly, the multi-scale compression excitation module (MCEM) compresses and excites the feature map, and combines it with contextual information to obtain better model performance capabilities. Furthermore, the introduction of the attention gate module marks a significant advancement in refining the feature map output. Finally, rigorous experimentation conducted on the original jaw cyst dataset provided by Quzhou People's Hospital to verify the validity of MARes-Net architecture. The experimental data showed that precision, recall, IoU and F1-score of MARes-Net reached 93.84%, 93.70%, 86.17%, and 93.21%, respectively. Compared with existing models, our MARes-Net shows its unparalleled capabilities in accurately delineating and localizing anatomical structures in the jaw cyst image segmentation.
BibTeX
@inproceedings{ding2024mares,
  author = {Xiaokang Ding and Xiaoliang Jiang and Huixia Zheng and Hualuo Shi and Ban Wang and Sixian Chan},
  title = {{MARes-Net: multi-scale attention residual network for jaw cyst image segmentation}},
  booktitle = {Frontiers in Bioengineering and Biotechnology},
  year = {2024},
  doi = {10.3389/fbioe.2024.1454728},
}
Figure