Imbalanced Loss-Integrated Deep-Learning-Based Ultrasound Image Analysis for Diagnosis of Rotator-Cuff Tear

Kyungsu Lee, Jun-Young Kim, Moon Hwan Lee, Chang-Hyuk Choi, Jae Youn Hwang

TL;DR

This paper introduces SMART-CA, a novel deep learning architecture for diagnosing rotator cuff tears (RCTs) from ultrasound images. By integrating a pre-trained encoder and a custom "imbalanced-on-positive-loss function" (IPLF), SMART-CA significantly improves segmentation accuracy, especially in noisy images, outperforming existing methods.

What Problem Does This Paper Address?

Diagnosing rotator cuff tears (RCTs) is crucial for effective treatment, but current imaging methods like MRI are costly and time-consuming. Ultrasound imaging (UI) offers a more accessible and affordable alternative, but its diagnostic utility is hampered by image quality issues, particularly speckle noise, and the inherent difficulty in segmenting the small, often subtle, RCT regions. Traditional computer vision techniques struggle with these challenges, and even existing deep learning models fall short of the accuracy needed for clinical application. This paper aims to bridge this gap by developing a robust deep learning system capable of accurately segmenting RCTs in ultrasound images, even under challenging conditions.

Methods

The core of this work is the SMART-CA (Segmentation Model Adopting a pRe-trained Classification Architecture). This model employs a dual-encoder architecture:

  • Pre-trained Encoder: Leverages a VGG19 network, pre-trained on a classification task to identify the presence of RCTs. This encoder is designed to extract highly discriminative features relevant to RCTs, which are then passed to the decoder. Crucially, this pre-trained encoder is not fine-tuned during the segmentation training phase, preserving its learned classification capabilities.
  • Trainable Encoder: A standard encoder that learns features directly from the ultrasound images for the segmentation task.
  • Decoder: An encoder-decoder structure (similar to U-Net) that combines features from both encoders to produce the final segmentation map.

A key innovation is the Integrated-on-Positive-Loss Function (IPLF). This custom loss function is designed to address the severe class imbalance inherent in RCT datasets (where RCT regions are much smaller than the background). Unlike standard loss functions that can be biased towards the majority class (background), IPLF specifically up-weights the gradients for the positive class (RCT), allowing the model to learn more effectively from these sparse, difficult-to-detect regions.

Datasets

The study utilized a dataset of 1400 ultrasound images acquired from 35 patients with varying sizes and states of rotator cuff tears. This dataset was split into training (840 images), validation (280 images), and testing (280 images) sets. The dataset is characterized by a significant class imbalance, with only 120 images of healthy shoulders compared to 1280 images of RCT shoulders. To further evaluate robustness, artificial speckle noise was added to the original images at different levels (PSNR of 15 dB, 12 dB, and 10 dB).

Key Insights and Ideas

  • Pre-trained Classification for Segmentation: Using a pre-trained classification network as an encoder for a segmentation task can significantly boost performance by injecting domain-specific feature extraction capabilities. The pre-trained encoder acts as a powerful feature extractor, focusing on subtle cues that a purely segmentation-trained encoder might miss.
  • Targeted Loss for Imbalance: The IPLF is crucial for handling the extreme class imbalance in medical imaging datasets. By specifically amplifying gradients for the minority class (RCTs), it prevents the model from being overwhelmed by the majority class (background) and allows for more accurate localization of small, critical regions.
  • Robustness to Noise: The combination of the pre-trained encoder and IPLF makes SMART-CA remarkably resilient to speckle noise, a common artifact in ultrasound imaging. This is a critical step towards reliable clinical deployment.

Key Results

SMART-CA demonstrated superior performance compared to other state-of-the-art models:

  • Overall Performance: Achieved precision, recall, and Dice coefficient of 0.604% (+38.4%), 0.942% (+14.0%), and 0.736% (+38.6%), respectively, on original ultrasound images.
  • Performance with Severe Noise: Even with severe speckle noise (PSNR = 10 dB), SMART-CA maintained strong performance, achieving precision, recall, and Dice coefficient of 0.337% (+22.5%), 0.860% (+15.8%), and 0.484% (+28.5%), respectively. This represents a significant improvement over other models, which showed drastically degraded performance at higher noise levels.
  • IPLF Effectiveness: The IPLF consistently outperformed other common loss functions (Binary Cross-Entropy, F1-Loss, Focal Loss) across various baseline architectures, leading to improved precision, recall, and Dice coefficients.

Limitations and Future Work

  • Pre-trained Encoder Accuracy Threshold: The study noted that segmentation performance degraded when the pre-trained encoder's classification accuracy exceeded 80%. The exact reason for this is not fully elucidated and remains an area for further investigation.
  • Hyperparameter Optimization: While grid search was used to find optimal IPLF hyperparameters (α and β), further exploration of more advanced optimization techniques could be beneficial.
  • Other Architectures: The paper suggests testing other state-of-the-art baseline architectures beyond VGG19 and U-Net to potentially further enhance SMART-CA's performance.
  • Low Contrast and Unclear Boundaries: While the study addressed noise and imbalance, future work could focus on improving segmentation in cases with low contrast and unclear boundaries of RCTs.

Summary updated

Abstract

A rotator cuff tear (RCT) is an injury in adults that causes difficulty in moving, weakness, and pain. Only limited diagnostic tools such as magnetic resonance imaging (MRI) and ultrasound Imaging (UI) systems can be utilized for an RCT diagnosis. Although UI offers comparable performance at a lower cost to other diagnostic instruments such as MRI, speckle noise can occur the degradation of the image resolution. Conventional vision-based algorithms exhibit inferior performance for the segmentation of diseased regions in UI. In order to achieve a better segmentation for diseased regions in UI, deep-learning-based diagnostic algorithms have been developed. However, it has not yet reached an acceptable level of performance for application in orthopedic surgeries. In this study, we developed a novel end-to-end fully convolutional neural network, denoted as Segmentation Model Adopting a pRe-trained Classification Architecture (SMART-CA), with a novel integrated on positive loss function (IPLF) to accurately diagnose the locations of RCT during an orthopedic examination using UI. Using the pre-trained network, SMART-CA can extract remarkably distinct features that cannot be extracted with a normal encoder. Therefore, it can improve the accuracy of segmentation. In addition, unlike other conventional loss functions, which are not suited for the optimization of deep learning models with an imbalanced dataset such as the RCT dataset, IPLF can efficiently optimize the SMART-CA. Experimental results have shown that SMART-CA offers an improved precision, recall, and dice coefficient of 0.604% (+38.4%), 0.942% (+14.0%) and 0.736% (+38.6%) respectively. The RCT segmentation from a normal ultrasound image offers the improved precision, recall, and dice coefficient of 0.337% (+22.5%), 0.860% (+15.8%) and 0.484% (+28.5%), respectively, in the RCT segmentation from an ultrasound image with severe speckle noise. The experimental results demonstrated the IPLF outperforms other conventional loss functions, and the proposed SMART-CA optimized with the IPLF showed better performance than other state-of-the-art networks for the RCT segmentation with high robustness to speckle noise.
BibTeX
@inproceedings{lee2021imbalanced,
  author = {Kyungsu Lee and Jun-Young Kim and Moon Hwan Lee and Chang-Hyuk Choi and Jae Youn Hwang},
  title = {{Imbalanced Loss-Integrated Deep-Learning-Based Ultrasound Image Analysis for Diagnosis of Rotator-Cuff Tear}},
  booktitle = {Sensors},
  year = {2021},
  url = {https://openreview.net/forum?id=EoP_uPiMGKM},
}
Figure