MAC-ResNet: Knowledge Distillation Based Lightweight Multiscale-Attention-Crop-ResNet for Eyelid Tumors Detection and Classification

Xingru Huang, Chunlei Yao, Feng Xu, Lingxiao Chen, Huaqiong Wang, Xiao‐Diao Chen, Juan Ye, Yaqi WangJournal of Personalized Medicine 2022 · DOI

TL;DR

This paper introduces MAC-ResNet, a novel deep learning architecture that leverages knowledge distillation to achieve highly accurate classification and localization of eyelid tumors from pathology images. By training a lightweight student network (ResNet50) to mimic a more complex teacher network (MAC-ResNet), they achieve state-of-the-art performance while enabling faster inference, crucial for clinical applications.

What Problem Does This Paper Address?

Diagnosing eyelid tumors from pathology slides is a challenging task due to the subtle morphological similarities between different types of malignant tumors like Basal Cell Carcinoma (BCC), Meibomian Gland Carcinoma (MGC), and Cutaneous Melanoma (CM). Furthermore, the actual diseased area often occupies a small portion of the entire pathology slide, making it time-consuming and labor-intensive for pathologists to identify and analyze these regions. This difficulty can lead to delayed or inaccurate diagnoses, impacting patient outcomes. The paper aims to automate both the classification of these tumors and the precise localization of the affected areas within whole slide images (WSIs).

Methods

The core of the proposed solution is the MAC-ResNet (Multiscale-Attention-Crop-ResNet) model. This architecture is built upon a Backbone-Attention-Crop-Model (BACM) module, which incorporates a ResNet backbone, a multi-scale attention mechanism, and a cropping strategy guided by attention maps. The attention mechanism helps the model focus on discriminative regions within the pathology images, and the cropping strategy then extracts these important areas for further analysis.

To address the computational demands of this complex model, the researchers employ knowledge distillation. In this approach, the MAC-ResNet model acts as a "teacher," trained to achieve high performance. A smaller, more efficient "student" network, ResNet50, is then trained to mimic the teacher's outputs, specifically its "soft labels" (probabilistic predictions). This allows the student network to learn the complex patterns from the teacher without needing the same extensive computational resources.

For lesion localization, a U-Net architecture is utilized, trained to segment the tumor regions. The entire pipeline involves data augmentation, preprocessing, patch-level classification, and finally, WSI-level segmentation and classification.

Datasets

The primary dataset used in this study is the ZJU-LS eyelid tumor (ZLet) dataset. This dataset comprises 728 whole slide images (WSIs) of eyelid tumors, along with corresponding tumor masks. It was collected from 132 patients between 2014 and 2021. The dataset is divided into three classes: Cutaneous Melanoma (CM), Basal Cell Carcinoma (BCC), and Meibomian Gland Carcinoma (MGC), with distributions of 481 CM, 136 BCC, and 111 MGC images. The paper notes that this is the largest eyelid tumor dataset reported to date. The dataset was split into training, validation, and testing sets.

Key Insights and Ideas

  • Knowledge Distillation for Medical Imaging: Applying knowledge distillation to medical image analysis, particularly for complex tasks like fine-grained tumor classification, is a promising avenue. It allows for the creation of efficient models that retain high accuracy, making them more practical for clinical deployment.
  • Attention and Cropping Synergy: The combination of multiscale attention to identify salient regions and a subsequent cropping strategy to focus on these areas is a powerful approach for extracting discriminative features from large pathology images. This helps overcome the challenge of small diseased regions within large WSIs.
  • Teacher-Student for Efficiency: The success of training a lightweight ResNet50 student model to achieve performance comparable to a more complex MAC-ResNet teacher highlights the effectiveness of this paradigm for resource-constrained environments or applications requiring faster inference.
  • Integrated Classification and Segmentation: The paper demonstrates the value of jointly addressing classification and segmentation. The segmentation maps not only locate the tumors but can also serve as attention maps, guiding further analysis and aiding pathologists in diagnosis.

Key Results

The proposed MAC-ResNet model achieved impressive classification accuracies on the ZLet dataset:

  • BCC: 96.8%
  • MGC: 94.6%
  • CM: 90.8%

The paper also reports high performance metrics for segmentation, with Dice scores reaching up to 0.8349 for BCC, 0.8050 for MGC, and 0.8307 for CM. The knowledge distillation approach enabled the student ResNet50 model to achieve significant improvements in classification performance.

Limitations and Future Work

The authors acknowledge several limitations:

  • Limited Dataset Size: While the ZLet dataset is the largest reported for eyelid tumors, it is still relatively small for extensive deep learning experiments. The authors suggest that more extensive experiments on larger datasets are needed to fully verify the performance of different methods under the teacher-student framework.
  • Limited Tumor Types: The study focused only on BCC, MGC, and CM. Eyelid tumors encompass a broader range of diseases, including squamous cell carcinoma (SCC), seborrheic keratosis (SK), and xanthelasma.
  • Future Work: The authors are currently working on a larger dataset, "ZLet-large," which includes over a thousand eyelid tumor pathology images. This expanded dataset will allow for more extensive experiments to explore a wider variety of tumor types and further investigate the potential of the teacher-student model in eyelid tumor analysis.

Summary updated

Abstract

Eyelid tumors are tumors that occur in the eye and its appendages, affecting vision and appearance, causing blindness and disability, and some having a high lethality rate. Pathological images of eyelid tumors are characterized by large pixels, multiple scales, and similar features. Solving the problem of difficult and time-consuming fine-grained classification of pathological images is important to improve the efficiency and quality of pathological diagnosis. The morphology of Basal Cell Carcinoma (BCC), Meibomian Gland Carcinoma (MGC), and Cutaneous Melanoma (CM) in eyelid tumors are very similar, and it is easy to be misdiagnosed among each category. In addition, the diseased area, which is decisive for the diagnosis of the disease, usually occupies only a relatively minor portion of the entire pathology section, and screening the area of interest is a tedious and time-consuming task. In this paper, deep learning techniques to investigate the pathological images of eyelid tumors. Inspired by the knowledge distillation process, we propose the Multiscale-Attention-Crop-ResNet (MAC-ResNet) network model to achieve the automatic classification of three malignant tumors and the automatic localization of whole slide imaging (WSI) lesion regions using U-Net. The final accuracy rates of the three classification problems of eyelid tumors on MAC-ResNet were 96.8%, 94.6%, and 90.8%, respectively.
BibTeX
@article{huang2022mac,
  author = {Xingru Huang and Chunlei Yao and Feng Xu and Lingxiao Chen and Huaqiong Wang and Xiao‐Diao Chen and Juan Ye and Yaqi Wang},
  title = {{MAC-ResNet: Knowledge Distillation Based Lightweight Multiscale-Attention-Crop-ResNet for Eyelid Tumors Detection and Classification}},
  journal = {Journal of Personalized Medicine},
  year = {2022},
  doi = {10.3390/jpm13010089},
}
Figure