Prototypical Cross-domain Knowledge Transfer for Cervical Dysplasia Visual Inspection

Yichen Zhang, Yifang Yin, Ying Zhang, Zhenguang Liu, Zheng Wang, Roger Zimmermann

TL;DR

Researchers have developed a new deep learning framework that improves cervical cancer screening by "borrowing" knowledge from secondary clinical datasets while filtering out unreliable or inconsistent labels. By using target-domain "prototypes" to validate auxiliary data, the model achieves a significant performance boost in detecting precancerous changes, even in low-resource settings.

What Problem Does This Paper Address?

Early detection of cervical dysplasia (precancerous changes) is vital for successful treatment. In many developing regions, doctors rely on Visual Inspection with Acetic Acid (VIA)—essentially looking at the cervix after applying vinegar—because it is low-cost. However, automating this with AI is difficult for two main reasons:

  1. Data Scarcity: High-quality, labeled medical image datasets are small and expensive to produce.
  2. The "Transfer" Problem: If you try to train a model on one dataset (Source) and apply it to another (Target), you hit two walls:
  3. Domain Shift: Images look different because they were taken with different cameras or in different lighting.
  4. Criterion Mismatch: Diagnosis is subjective. A nurse in one clinic might label a case differently than a doctor in another, leading to "noisy" or inconsistent labels that confuse the AI.

Methods

The authors propose a Y-shaped architecture designed to align two different datasets into a single, coherent "understanding." Their framework consists of two primary modules:

  • Early Domain Alignment (EDA): This module works at the intermediate feature level. It uses either adversarial training (forcing the model to ignore which dataset an image came from) or divergence-based metrics (MK-MMD) to ensure that the basic visual features are consistent across both domains.
  • Prototypical Semantic Alignment (PSA): This is the core innovation. Instead of trusting the auxiliary labels blindly, the model calculates "prototypes"—the average feature representation for each class (e.g., "Normal" vs. "Abnormal") in the target dataset.
  • It then checks auxiliary samples against these prototypes. If an auxiliary sample's original label doesn't match its proximity to the target prototypes, it's flagged as "high-uncertainty" and its influence is reduced.
  • Finally, it uses Supervised Contrastive Learning to pull samples of the same class together and push different classes apart in the feature space, creating a much sharper decision boundary.

Datasets

The study utilized 17,002 cervical images from three major clinical studies:

  • NHS (Natural History Study of HPV): Used as a primary benchmark.
  • ALTS (ASCUS-LSIL Triage Study): Used as auxiliary data.
  • Biopsy Study: A smaller, more challenging dataset used to test the model's robustness.
  • Visda-2017: A general-purpose computer vision dataset used to prove the method works outside of just medical imaging.

Key Insights and Ideas

  • Prototypes as Anchors: The most important "aha moment" is using the target domain's class centroids as the "ground truth" reference. This allows the model to treat auxiliary data as a helpful but potentially "unreliable witness," filtering out the noise caused by subjective human labeling.
  • Simultaneous Alignment: The paper demonstrates that you must align data at both the domain level (how the images look) and the class level (what the images mean) simultaneously to get the best results.
  • Robustness to Small Data: The framework is particularly effective when the target dataset is very small (e.g., the Biopsy dataset), showing that smart knowledge transfer is more effective than simply collecting more low-quality data.

Key Results

The proposed method (specifically the Ours-adv variant) significantly outperformed existing state-of-the-art models:

  • On the NHS Dataset: Achieved an absolute improvement of 4.7% in top-1 accuracy, 7.0% in precision, and 4.6% in F1 score.
  • ROC-AUC: Reached 0.886, indicating high reliability in distinguishing between normal and dysplastic cases.
  • Generalization: On the non-medical Visda-2017 dataset, it outperformed the next best method by nearly 4% in accuracy, proving the framework's broad utility.

Limitations and Future Work

  • Single Modality: The current model only looks at images. In clinical practice, doctors also use metadata like HPV test results or patient history. The authors note that integrating this multi-modal data is a logical next step.
  • Binary Focus: The evaluation focused on binary classification (Normal vs. Abnormal). Future work could expand this to more granular CIN grades (CIN1, CIN2, CIN3) to better assist in specific treatment planning.
  • Cross-Modal Potential: The authors suggest investigating how this "prototypical" approach could work when transferring knowledge between entirely different types of data (e.g., from ultrasound to colposcopy).

Summary updated

Abstract

Early detection of dysplasia of the cervix is critical for cervical cancer treatment. However, automatic cervical dysplasia diagnosis via visual inspection, which is more appropriate in low-resource settings, remains a challenging problem. Though promising results have been obtained by recent deep learning models, their performance is significantly hindered by the limited scale of the available cervix datasets. Distinct from previous methods that learn from a single dataset, we propose to leverage cross-domain cervical images that were collected in different but related clinical studies to improve the model's performance on the targeted cervix dataset. To robustly learn the transferable information across datasets, we propose a novel prototype-based knowledge filtering method to estimate the transferability of cross-domain samples. We further optimize the shared feature space by aligning the cross-domain image representations simultaneously on domain level with early alignment and class level with supervised contrastive learning, which endows model training and knowledge transfer with stronger robustness. The empirical results on three real-world benchmark cervical image datasets show that our proposed method outperforms the state-of-the-art cervical dysplasia visual inspection by an absolute improvement of 4.7% in top-1 accuracy, 7.0% in precision, 1.4% in recall, 4.6% in F1 score, and 0.05 in ROC-AUC.
BibTeX
@inproceedings{zhang2023prototypical,
  author = {Yichen Zhang and Yifang Yin and Ying Zhang and Zhenguang Liu and Zheng Wang and Roger Zimmermann},
  title = {{Prototypical Cross-domain Knowledge Transfer for Cervical Dysplasia Visual Inspection}},
  booktitle = {ACM Multimedia},
  year = {2023},
  doi = {10.1145/3581783.3612000},
}

Loading related content...

Figure