A Quantitative Analysis Platform for PD-L1 Immunohistochemistry based on Point-level Supervision Model

Haibo Mi, Kele Xu, Yang Xiang, Yulin He, Dawei Feng, Huaimin Wang, Chun Wu, Yanming Song, Xiaolei Sun

Abstract

Quantifying Programmed Death-Ligand 1 (PD-L1) expression is a critical component of personalized cancer immunotherapy, yet manual assessment of Whole Slide Images (WSIs) is labor-intensive and prone to error. This paper introduces an automated platform utilizing a point-level supervision model to identify and count cell nuclei across gigapixel pathology images. By replacing complex mask-level annotations with simple point-level dots, the system significantly reduces the data labeling burden. The platform integrates a Fully Convolutional Network (FCN) with a Map-Reduce framework for parallel processing, achieving high accuracy and real-world clinical utility in identifying PD-L1 positive tumor cells.

Introduction

In precision oncology, the PD-L1 protein serves as a vital biomarker for determining patient eligibility for specific immunotherapies. Clinical assessment requires calculating a "Positive Score," which is the ratio of PD-L1 positive tumor cells to total tumor cells. However, pathologists must navigate WSIs that often exceed 1GB and contain millions of nuclei. Traditional automated tools frequently rely on mask-level annotations—tracing the exact boundaries of every cell—which is prohibitively time-consuming for medical experts to generate at scale. This research addresses these challenges by proposing a detection-based platform that operates on point-level supervision.

Methodology

Point-Level Supervision Model

The core of the platform is a Fully Convolutional Network (FCN) utilizing a ResNet101 backbone. Unlike segmentation models that require pixel-perfect outlines, this model is trained using simple dots placed at the center of nuclei. To enhance performance, the team integrated dilated convolutions to expand the receptive field without sacrificing resolution.

The interactive UI displays point-level annotations where red dots represent positive tumor nuclei and yellow dots represent negative nuclei.

To address "nuclear stacking"—a common issue where cells overlap in tissue samples—the researchers implemented a "nuclear split loss" based on the Histogram of Oriented Gradients (HOG). This classic computer vision technique helps the deep learning model distinguish between individual cells in crowded clusters. Finally, Non-Maximum Suppression (NMS) is applied during inference to ensure each cell is counted only once.

System Architecture

To handle the massive scale of gigapixel images, the platform employs a robust Image Processing Engine based on a Map-Reduce framework. The system splits large images into smaller sub-pictures, distributes them across multiple "Detecting Agents" for parallel processing, and then merges the results for display in an interactive user interface.

The system architecture illustrates the workflow from the Interactive UI through the Image Processing Engine to parallel Detecting Agents.

Datasets and Evaluation

The model was trained and validated on thousands of PD-L1 images from Lung Squamous Carcinoma and Ductal Breast Carcinoma. Annotations consisted of red dots for positive tumor nuclei and yellow dots for negative nuclei. The authors found that point-level annotation for a standard $1024 \times 1204$ image takes only a few minutes, representing a massive efficiency gain over traditional labeling methods.

Key Results and Clinical Impact

Comparative analysis demonstrated that the FCN-ResNet101 configuration outperformed other popular architectures, including DUNet and DeepLab-v3, achieving the highest accuracy and lowest false-positive rates. Beyond theoretical performance, the platform has been deployed at a first-class hospital in China. It assists pathologists by providing full-scale profiles of PD-L1 expression across entire tissue slides in a fraction of the time required for manual counting.

Conclusion and Future Work

This platform demonstrates that point-level supervision provides a "sweet spot" for clinical pathology, offering sufficient spatial information for accurate metrics without the prohibitive cost of mask-level segmentation. While currently optimized for lung and breast carcinomas, future work will focus on expanding the model's capabilities to a wider variety of cancer types and further refining cell detection in extremely dense tissue regions.

Summary updated

Abstract

Recently, deep learning has witnessed dramatic progress in the medical image analysis field. In the precise treatment of cancer immunotherapy, the quantitative analysis of PD-L1 immunohistochemistry is of great importance. It is quite common that pathologists manually quantify the cell nuclei. This process is very time-consuming and error-prone. In this paper, we describe the development of a platform for PD-L1 pathological image quantitative analysis using deep learning approaches. As point-level annotations can provide a rough estimate of the object locations and classifications, this platform adopts a point-level supervision model to classify, localize, and count the PD-L1 cells nuclei. Presently, this platform has achieved an accurate quantitative analysis of PD-L1 for two types of carcinoma, and it is deployed in one of the first-class hospitals in China.
BibTeX
@inproceedings{mi2019quantitative,
  author = {Haibo Mi and Kele Xu and Yang Xiang and Yulin He and Dawei Feng and Huaimin Wang and Chun Wu and Yanming Song and Xiaolei Sun},
  title = {{A Quantitative Analysis Platform for PD-L1 Immunohistochemistry based on Point-level Supervision Model}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2019},
  doi = {10.24963/ijcai.2019/954},
}
Figure