Abstract
Early diagnosis is critical for the effective treatment of skin cancer. While machine learning techniques, particularly convolutional neural networks (CNNs), have shown promise in medical image analysis, their performance is often hampered by the extreme scarcity of malignant samples in clinical datasets. This paper proposes a novel ensemble-based CNN architecture that integrates multiple models trained on various image scales, hybrid transfer learning, and patient metadata. By utilizing a Support Vector Machine (SVM) as a meta-learner, the proposed approach significantly improves classification performance on highly imbalanced data, outperforming several state-of-the-art benchmarks.
Introduction
Skin cancer detection presents a significant challenge for automated systems due to the extreme class imbalance found in real-world datasets. In the ISIC 2020 archive, for instance, malignant lesions represent less than 2% of the total images. Standard CNNs often struggle with this imbalance, frequently defaulting to the majority (benign) class to maintain high overall accuracy while failing to identify the clinically critical minority (malignant) class. While transfer learning from general-purpose datasets like ImageNet provides a starting point, it often lacks the specificity required for nuanced dermatological features.
Proposed Methodology
The core of the proposed system is a multi-stage ensemble architecture designed to maximize the diversity of information extracted from dermoscopic images. The architecture consists of three primary components:
- Multi-Scale Base-Learners: The system employs six CNN base-learners. Four are trained from scratch on the target dataset using varying input resolutions (32×32, 64×64, 128×128, and 256×256). This multi-scale approach allows the ensemble to simultaneously capture fine-grained textures and broader structural patterns.
- Hybrid Transfer Learning: To inject prior dermatological knowledge, two additional base-learners are pre-trained on a separate, balanced skin cancer dataset from the ISIC archive. This helps mitigate the bias introduced by the primary dataset's imbalance.
- SVM Meta-Learner: Rather than simple averaging, the predicted probabilities from all six CNNs are combined with auxiliary patient metadata (age, sex, and anatomical site). These inputs are fed into an SVM with a Radial Basis Function (RBF) kernel, which learns to optimally weight the various inputs for a final diagnosis.
Dataset and Experimental Setup
The primary evaluation was conducted using the ISIC 2020 Challenge dataset, which contains 33,126 dermoscopic images from 2,056 patients. The dataset is characterized by extreme imbalance, with only 584 malignant images. For the pre-trained components, a balanced archive from 2019 was utilized to prevent data leakage.
Experimental Results
The proposed ensemble method was compared against seven benchmarks, including traditional classifiers and recent deep learning techniques. The results demonstrate the superiority of the ensemble approach in imbalanced contexts:
- F1-Measure: The proposed method achieved an F1-score of 0.23, nearly doubling the performance of some recent CNN-based approaches (e.g., Mahbod et al. at 0.12).
- AUC-PR: In the presence of high imbalance, the Area Under the Precision-Recall curve is a critical metric. The proposed method reached 0.16, significantly higher than the 0.12–0.13 range of top benchmarks.
- AUC-ROC: The model maintained a strong overall discriminative power with an AUC-ROC of 0.87.
A key insight from the results is that the ensemble outperforms its individual components. Even if base-learners have lower individual F1-scores, their diverse errors allow the meta-learner to filter noise and improve the final classification.
Conclusion
This research highlights the power of ensemble learning and multi-scale feature extraction in addressing the challenges of imbalanced medical data. By combining specialized CNNs with clinical metadata, the proposed architecture offers a more robust tool for early skin cancer detection. Future work will explore the use of Generative Adversarial Networks (GANs) to synthesize minority class samples and the integration of richer hyperspectral data to further refine diagnostic accuracy.
Summary updated