Automated PD-L1 Tumor Proportion Scoring with Uncertainty-Guided Triage in Non-Small Cell Lung Cancer

Kesi Xu, Ayesha Azam, Tanvier Kaur, Monika Kondratowicz, Kinza Asim, Brinder Chohan, Paapa Appiah-Odame, Zhao Chen, David Snead, Nasir RajpootarXiv 2026 · arXiv

This paper presents a three-stage deep learning framework for automated PD-L1 Tumor Proportion Scoring (TPS) in non-small cell lung cancer (NSCLC). The core innovation is TPS-Guard, an uncertainty-guided triage system that identifies difficult cases for pathologist review, particularly those near critical clinical thresholds (1% and 50%), where scoring errors can significantly impact treatment eligibility.

TL;DR

The authors developed a three-stage AI framework that automates PD-L1 scoring and uses model ensemble disagreement to triage the most "uncertain" cases to pathologists. The system achieves human-level accuracy and demonstrates that model uncertainty is a strong predictor of both automated error and inter-pathologist disagreement.

What Problem Does This Paper Address?

Immunotherapy selection for lung cancer patients relies heavily on the PD-L1 Tumor Proportion Score (TPS)—the percentage of viable tumor cells showing membranous staining. However, manual scoring is notoriously difficult. Pathologists must distinguish stained tumor cells from "mimics" like macrophages and immune cells, often in heterogeneous tissue samples.

Small errors are especially consequential near the 1% and 50% cutoffs, which determine whether a patient receives specific therapies. While previous AI tools have attempted to automate this, they often lack a mechanism to signal when they are likely to be wrong. This paper addresses the need for a "safety net" that integrates AI efficiency with human expertise.

Methods

The framework follows a logical three-stage sequence:

  1. Stage 1: Tumor Segmentation: Uses a linear classifier on features from Virchow2 (a vision transformer foundation model) to identify tumor regions and, crucially, exclude macrophage-rich patches that often lead to false positives.
  2. Stage 2: D2Count-Net: A dual-branch cell counting network. One branch performs point detection (ideal for sparse cells), while the other performs density estimation (better for crowded regions). A "scene classifier" dynamically weights these two outputs based on local cellularity.
  3. Stage 3: TPS-Guard: This is the triage layer. The authors trained an ensemble of 15 models. Uncertainty is defined as the standard deviation of the TPS estimates across these models. If the models disagree significantly, or if the score sits precariously near a clinical cutoff, the case is flagged for manual review.
Overview of the three-stage TPS estimation framework, including tumor finding, dual-branch counting, and the TPS-Guard triage mechanism.

Datasets

  • Development Cohort (UHCW): 154 whole-slide images (WSIs) from University Hospitals Coventry and Warwickshire, stained with the SP263 assay. Three pathologists provided independent scores to establish a "three-reader mean" reference.
  • External Validation Cohort (IGNITE): 98 regions of interest (ROIs) from two European centers, featuring different antibody clones (SP263 and E1L3N) and scanners to test generalizability.
Summary of the development and external validation cohorts, including specimen types and TPS distributions.

Key Insights and Ideas

  • Uncertainty as a Proxy for Difficulty: A major "aha" moment was finding that model uncertainty correlates strongly with inter-pathologist disagreement ($\rho = 0.71$). This suggests that the cases the AI finds "hard" are the same ones humans struggle to agree on.
  • Hybrid Counting is Essential: By combining detection and density branches, the model handles the full spectrum of tissue morphology—from scattered tumor cells to dense, solid nests—more robustly than either method alone.
  • Triage Improves the Whole System: Referring just the 15% most uncertain slides significantly reduced the Mean Absolute Error (MAE) for the remaining "auto-reported" cases, bringing the AI's performance in line with the most accurate pathologists.
Detailed view of the TPS-Guard triage logic, showing how high uncertainty leads to pathologist referral while low uncertainty allows for auto-reporting.

Key Results

  • Human-Level Accuracy: On unseen test slides, the model's MAE was 6.96 percentage points, falling squarely within the range of the three expert pathologists (4.24 to 8.29).
  • Effective Triage: After referring the 15% most uncertain slides, the MAE on the remaining auto-reported slides dropped to 4.96.
  • Zero-Shot Generalization: When applied to the external IGNITE dataset without retraining, the triage system still successfully directed review to higher-error cases, although absolute error was higher on the E1L3N clone (which the model hadn't seen during training).
  • Sensitivity at Cutoffs: Referring more uncertain cases raised the sensitivity at the critical 50% cutoff, ensuring fewer high-PD-L1 patients were missed.

Limitations and Future Work

  • Clone Sensitivity: The model performed significantly better on the SP263 clone (used in training) than the E1L3N clone. Future work should focus on more diverse training sets to improve "out-of-the-box" performance across different assays.
  • Class Imbalance: The training data was imbalanced, with only 6% of annotated nuclei being PD-L1 positive. The authors noted that more positive cell annotations are needed to further refine the counting branches.
  • Prospective Validation: This was a retrospective study. The next step is a prospective "reader study" to see how TPS-Guard actually affects pathologist workflow, confidence, and reporting time in a live clinical environment.

Summary updated

Abstract

Programmed death-ligand 1 (PD-L1) tumor proportion score (TPS) informs immunotherapy selection in non-small cell lung cancer. Near the 1% and 50% cutoffs, the score should also indicate when closer review is warranted. We designed a three-stage framework to follow the sequence of TPS assessment. Stage 1 identifies tumor regions and excludes macrophage-rich patches. Stage 2, a dual-branch cell counting network (D2Count-Net), counts PD-L1-positive and PD-L1-negative tumor cells in these regions to calculate TPS. Stage 3, TPS-Guard, an uncertainty-guided triage mechanism, reports model uncertainty as the disagreement among independently trained models, refers the most uncertain slides, and flags scores near the 1% or 50% cutoff when model estimates disagree across that cutoff. Flags state the reason for referral or alert the pathologist to possible scoring errors on auto-reported slides. In a retrospective, single-center study, 154 whole-slide images were scored by three pathologists, and the model and each pathologist were compared in turn with the mean of the other two. On the 114 slides unseen in training, model mean absolute error (MAE) was 6.96 percentage points, within the range of the three pathologists (4.24 to 8.29), and model uncertainty correlated with absolute TPS error (Spearman rho = 0.77) and inter-pathologist disagreement (rho = 0.71). After referral of the 15% most uncertain slides, model and pathologist MAE both decreased. Applied without retraining to an external, publicly available dataset, TPS-Guard still directed review to higher-error cases, and referring more uncertain cases raised sensitivity at the 50% cutoff. TPS-Guard provides reasons for reviewing individual automated scores and identifies slides that also produce greater disagreement among pathologists. Prospective reader studies should assess TPS-Guard's effect on TPS reporting.
BibTeX
@misc{xu2026automated,
  author = {Kesi Xu and Ayesha Azam and Tanvier Kaur and Monika Kondratowicz and Kinza Asim and Brinder Chohan and Paapa Appiah-Odame and Zhao Chen and David Snead and Nasir Rajpoot},
  title = {{Automated PD-L1 Tumor Proportion Scoring with Uncertainty-Guided Triage in Non-Small Cell Lung Cancer}},
  year = {2026},
  eprint = {2611.16907},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.16907},
}
Figure