Prediction of skin disease using a new cytological taxonomy based on cytology and pathology with deep residual learning method

Jin Bu, Yu Lin, Li-Qiong Qing, Gang Hu, Pei Wen Jiang, Haifeng Hu, Erxia ShenScientific 2021 · DOI

Abstract

While artificial intelligence (AI) has significantly improved skin disease classification, most models rely on the International Classification of Diseases, Tenth Revision (ICD-10), which was designed for clinical record-keeping rather than biological feature recognition. This study introduces a new taxonomy based on cytology and pathology ("Taxonomy 2") and evaluates its predictive performance using a Deep Residual Learning method. Our results demonstrate that this biologically aligned taxonomy achieves superior accuracy, F1-scores, and generalization compared to the standard ICD-10 system, suggesting high potential for clinical application in dermatology.

The Problem with Traditional Classification

In dermatology, diagnostic accuracy for general practitioners often ranges between 48% and 77% due to the visual similarity of over 1,500 distinct conditions. While computer vision models offer a solution, they are typically trained on ICD-10 categories. However, ICD-10 was built for human billing and record-keeping, not for the cellular and organic features that deep learning models actually extract from images. This misalignment can lead to models that struggle to distinguish between diseases that look different clinically but share similar cellular origins.

Methods: A Cytological Approach

To address this, researchers developed Taxonomy 2, a six-level hierarchical tree structure built from the bottom up based on cellular similarities. The system is organized around three primary root nodes:

  1. Keratinogenic diseases (originating in keratinocytes)
  2. Melanogenic diseases (originating in melanocytes)
  3. Non-KC and non-MC diseases (related to other cell types)
Figure 3: The hierarchical tree structure of Taxonomy 2, grouping diseases by cellular origin.

The study utilized a Deep Residual Learning (ResNet-50) model pre-trained on ImageNet. To compare the systems, the researchers established four "Projects": Project 1 served as the ICD-10 baseline, while Projects 2-4 represented increasingly granular levels of the new cytological taxonomy.

Dataset and Training

The researchers aggregated a pool of 56,571 images from eight public databases. To ensure a rigorous head-to-head comparison, they curated a subset of 1,160 images where diseases were clearly identifiable in both the ICD-10 and the new cytological system. For each project, two-thirds of the images were used for training, and one-third served as the test group.

Key Results

The most significant findings emerged from Project 4, the most detailed level of the new taxonomy. Taxonomy 2 demonstrated a remarkable ability to generalize to unseen data compared to the ICD-10 baseline.

Figure 5: Performance metrics comparing the ICD-10 baseline (Project 1) against the new cytological taxonomy levels (Projects 2-4).

Key performance highlights include:

  • F1-Score Improvement: In the test group, the new taxonomy achieved an F1-score of 91.88%, significantly outperforming the ICD-10 baseline of 74.43% ($P = 0.005$).
  • Reliability: The Kappa scores were consistently higher for Taxonomy 2, indicating more reliable predictions that account for chance.
  • Stability: While ICD-10 performance dropped sharply when moving from training to testing data, Taxonomy 2 remained stable, proving its superior "extension" to unknown diagnostic data.

Discussion and Conclusion

The success of Taxonomy 2 suggests that AI performs best when labels align with underlying biology. By grouping diseases by cellular origin, the visual features the AI extracts—such as texture and cell structure—align more closely with the categorical labels. This hierarchical flexibility allows for high accuracy even at broad levels of diagnosis.

While future work should incorporate histopathological and dermoscopic images to further refine the model, this study proves that a cytologically-based taxonomy provides a more robust foundation for AI-assisted dermatology than current clinical standards.

Summary updated

Abstract

With the development of artificial intelligence, technique improvement of the classification of skin disease is addressed. However, few study concerned on the current classification system of International Classification of Diseases, Tenth Revision (ICD)-10 on Diseases of the skin and subcutaneous tissue, which is now globally used for classification of skin disease. This study was aimed to develop a new taxonomy of skin disease based on cytology and pathology, and test its predictive effect on skin disease compared to ICD-10. A new taxonomy (Taxonomy 2) containing 6 levels (Project 2-4) was developed based on skin cytology and pathology, and represents individual diseases arranged in a tree structure with three root nodes representing: (1) Keratinogenic diseases, (2) Melanogenic diseases, and (3) Diseases related to non-keratinocytes and non-melanocytes. The predictive effects of the new taxonomy including accuracy, precision, recall, F1, and Kappa were compared with those of ICD-10 on Diseases of the skin and subcutaneous tissue (Taxonomy 1, Project 1) by Deep Residual Learning method. For each project, 2/3 of the images were included as training group, and the rest 1/3 of the images acted as test group according to the category (class) as the stratification variable. Both train and test groups in the Projects (2 and 3) from Taxonomy 2 had higher F1 and Kappa scores without statistical significance on the prediction of skin disease than the corresponding groups in the Project 1 from Taxonomy 1, however both train and test groups in Project 4 had a statistically significantly higher F1-score than the corresponding groups in Project 1 (P = 0.025 and 0.005, respectively). The results showed that the new taxonomy developed based on cytology and pathology has an overall better performance on predictive effect of skin disease than the ICD-10 on Diseases of the skin and subcutaneous tissue. The level 5 (Project 4) of Taxonomy 2 is better on extension to unknown data of diagnosis system assisted by AI compared to current used classification system from ICD-10, and may have the potential application value in clinic of dermatology.
BibTeX
@inproceedings{bu2021prediction,
  author = {Jin Bu and Yu Lin and Li-Qiong Qing and Gang Hu and Pei Wen Jiang and Haifeng Hu and Erxia Shen},
  title = {{Prediction of skin disease using a new cytological taxonomy based on cytology and pathology with deep residual learning method}},
  booktitle = {Scientific},
  year = {2021},
  doi = {10.1038/s41598-021-92848-y},
}
Figure