Nuclear Pleomorphism in Canine Cutaneous Mast Cell Tumors: Comparison of Reproducibility and Prognostic Relevance between Estimates, Manual Morphometry and Algorithmic Morphometry

Andreas Haghofer, Cem Parlak, Alexander Bartel, Taryn Donovan, Charles‐Antoine Assenmacher, Pompei Bolfă, Michael J. Dark, Andrea Fuchs‐Baumgartinger, Andrea Klang, Kathrin Jäger, Robert Klopfleisch, Sophie Merz, Barbara Richter, F. Y. Schulman, Jonathan Ganz, Josef Scharinger, Marc Aubreville, Stephan Winkler, Matti Kiupel, Christof Bertram, Bertram, Christof A.

This study, led by Andreas Haghofer and Christof Bertram, tackles a long-standing bottleneck in veterinary oncology: the subjective nature of tumor grading. By comparing traditional pathologist "eyeballing" with deep learning-based measurements, the researchers demonstrate that automated AI tools can predict canine mast cell tumor outcomes with significantly higher accuracy and reproducibility than human experts.

TL;DR

Pathologists’ visual estimates of nuclear size variation (anisokaryosis) are notoriously inconsistent. This paper shows that a deep learning model can quantify these features in seconds, outperforming human experts in predicting patient survival and offering a "practicable" middle-ground manual method for clinics without AI access.

What Problem Does This Paper Address?

In cancer diagnostics, the variation in the size and shape of cell nuclei—known as nuclear pleomorphism—is a critical indicator of how aggressive a tumor is. For canine cutaneous mast cell tumors (ccMCT), pathologists typically estimate this variation (anisokaryosis) visually, often using vague categories like "mild," "moderate," or "severe."

The problem is two-fold:

  1. Subjectivity: One pathologist’s "moderate" is another’s "severe," leading to poor reproducibility.
  2. Efficiency: While manually measuring nuclei (morphometry) is more accurate, it is incredibly time-consuming. Measuring the "gold standard" of 100 nuclei takes nearly 20 minutes per case—a luxury most diagnostic labs don't have.

Methods

The researchers compared four distinct approaches to evaluating nuclear features:

  • Visual Estimates: 11 pathologists graded tumors using two-tier and three-tier systems.
  • Gold Standard Manual Morphometry: A pathologist manually outlined 100+ nuclei per case.
  • Practicable Manual Morphometry: A novel "shortcut" where pathologists measured only 12 representative nuclei using stratified sampling (4 small, 4 intermediate, 4 large).
  • Automated Morphometry: A deep learning model based on the U-Net++ architecture was trained to segment nuclei and calculate area, eccentricity, and solidity automatically.

The primary metric used for prognosis was the Standard Deviation (SD) of the nuclear area, which serves as a mathematical proxy for anisokaryosis.

Datasets

The study utilized two primary datasets:

  1. Ground Truth Dataset: 85 images containing 40,542 manually annotated nuclei. This was used to train and validate the segmentation algorithm.
  2. Outcome Dataset: 96 ccMCT cases with known clinical outcomes (at least 12 months of follow-up). This allowed the team to correlate morphometric measurements with actual patient survival.
  3. Multi-institutional source: Samples were pulled from four different laboratories (MSU, Berlin, Vienna, and NYC) to ensure the AI could handle variations in lab-specific staining and processing.

Key Insights and Ideas

  • The "12 Nuclei" Strategy: Surprisingly, measuring just 12 nuclei using a stratified approach provided a better prognostic value (AUC 0.868) than the 100-nuclei gold standard (AUC 0.839). This suggests that how you sample (picking the extremes) is more important than how many you sample.
  • The Threshold Problem: The study confirmed that human inconsistency isn't just about "bad eyes"—it's about "shifting goalposts." Pathologists applied the definition of "karyomegaly" (enlarged nuclei) so differently that their inter-rater reproducibility was rated as "slight to fair" ($\kappa$ = 0.226).
  • AI as a Prognostic Powerhouse: The automated model achieved an Area Under the Curve (AUC) of 0.943 for predicting tumor-specific death. This outperformed the Mitotic Count (AUC 0.885), which is currently considered the single most important histological predictor for these tumors.

Key Results

  • Reproducibility: The AI is 100% reproducible (it gives the same answer every time for the same image). In contrast, the "practicable" manual method (12 nuclei) showed "good" agreement (ICC = 0.654), a massive step up from visual estimation.
  • Accuracy: The AI segmentation achieved a Dice score of 0.785 and an F1 score of 0.854, indicating high precision in identifying and outlining individual nuclei even in "noisy" images with heavy granulation.
  • Survival Prediction: Using a threshold of $\ge$ 9.0 µm² for the SD of nuclear area, the AI could distinguish between high-risk and low-risk patients with high sensitivity.

Limitations and Future Work

The authors acknowledge several hurdles before this hits every vet clinic:

  • Cause of Death: Survival data relied on clinician reports rather than autopsies, which can introduce bias.
  • Low Event Count: Only 13 of the 96 cases resulted in tumor-related death, making multivariate statistical analysis difficult.
  • Domain Shift: While the model was tested on multiple labs, it still needs validation on a wider variety of whole-slide scanners and staining protocols.
  • Tumor Heterogeneity: Tumors aren't uniform. The study found that 41% of cases had "divergent" measurements across different regions of the same tumor, suggesting that where the pathologist chooses to look still matters immensely.

Summary updated

Abstract

Variation in nuclear size and shape is an important criterion of malignancy for many tumor types; however, categorical estimates by pathologists have poor reproducibility. Measurements of nuclear characteristics (morphometry) can improve reproducibility, but manual methods are time consuming. The aim of this study was to explore the limitations of estimates and develop alternative morphometric solutions for canine cutaneous mast cell tumors (ccMCT). We assessed the following nuclear evaluation methods for measurement accuracy, reproducibility, and prognostic utility: 1) anisokaryosis (karyomegaly) estimates by 11 pathologists; 2) gold standard manual morphometry of at least 100 nuclei; 3) practicable manual morphometry with stratified sampling of 12 nuclei by 9 pathologists; and 4) automated morphometry using a deep learning-based segmentation algorithm. The study dataset comprised 96 ccMCT with available outcome information. The study dataset comprised 96 ccMCT with available outcome information. Inter-rater reproducibility of karyomegaly estimates was low ($κ$ = 0.226), while it was good (ICC = 0.654) for practicable morphometry of the standard deviation (SD) of nuclear size. As compared to gold standard manual morphometry (AUC = 0.839, 95% CI: 0.701 - 0.977), the prognostic value (tumor-specific survival) of SDs of nuclear area for practicable manual morphometry (12 nuclei) and automated morphometry were high with an area under the ROC curve (AUC) of 0.868 (95% CI: 0.737 - 0.991) and 0.943 (95% CI: 0.889 - 0.996), respectively. This study supports the use of manual morphometry with stratified sampling of 12 nuclei and algorithmic morphometry to overcome the poor reproducibility of estimates.
BibTeX
@inproceedings{haghofer2024nuclear,
  author = {Andreas Haghofer and Cem Parlak and Alexander Bartel and Taryn Donovan and Charles‐Antoine Assenmacher and Pompei Bolfă and Michael J. Dark and Andrea Fuchs‐Baumgartinger and Andrea Klang and Kathrin Jäger and Robert Klopfleisch and Sophie Merz and Barbara Richter and F. Y. Schulman and Jonathan Ganz and Josef Scharinger and Marc Aubreville and Stephan Winkler and Matti Kiupel and Christof Bertram and Bertram, Christof A.},
  title = {{Nuclear Pleomorphism in Canine Cutaneous Mast Cell Tumors: Comparison of Reproducibility and Prognostic Relevance between Estimates, Manual Morphometry and Algorithmic Morphometry}},
  booktitle = {Veterinary},
  year = {2024},
  doi = {10.1177/03009858241295399},
}
Figure