U-Net as a deep learning-based method for platelets segmentation in microscopic images

Eva Maria Valerio de Sousa, Ajay Kumar, Charlie Coupland, Tânia F. Vaz, Will Jones, Rubén Valcarce-Diñeiro, Simon D. J. CalaminusmedRxiv 2024 · DOI

TL;DR

Researchers have developed a highly accurate automated system for segmenting and counting platelets in microscopic images using a modified U-Net architecture. By leveraging strategic data augmentation and optimized preprocessing, the model achieved a near-perfect Dice score of 0.99, significantly outperforming traditional Fully Convolutional Networks (FCNs) and offering a robust alternative to tedious manual counting.

What Problem Does This Paper Address?

In hematology and cell biology, counting platelets is a fundamental task, yet doing it manually is a researcher’s nightmare: it is incredibly time-consuming, highly subjective, and prone to human error. Platelets present a specific challenge for computer vision because they are often dense, adherent (clumping together), and appear in low-contrast environments.

While Deep Learning has revolutionized image analysis, standard Convolutional Neural Networks (CNNs) designed for classification don't handle the "pixel-level localization" required to delineate individual cell boundaries. The authors sought to bridge this gap by comparing two popular architectures—U-Net and FCN—to determine which could best handle the complexities of platelet morphology in varying experimental conditions.

Methods

The study implemented and compared two deep learning architectures:

  • U-Net: Specifically, a four-layer version (rather than the standard five) to prevent over-parameterization while maintaining the critical "skip connections" that pass high-resolution features from the encoder to the decoder.
  • Fully Convolutional Network (FCN): An architecture that utilizes a classification backbone (like ImageNet) but replaces fully connected layers with convolutional ones to produce spatial maps.

Key Technical Approaches: * Preprocessing: The team used CLAHE (Contrast Limited Adaptive Histogram Equalization) to enhance image contrast without amplifying noise. * Ground Truth Creation: Since the dataset lacked manual annotations, the authors used a binarization thresholding method to create initial masks, which were then used to train the supervised models. * Optimization: They employed the Adam optimizer with a learning rate of 1E-4 and a binary cross-entropy loss function.

Datasets

The study utilized a dataset from the University of Hull consisting of microscopy images of human blood platelets treated with various substances (Zinc, Milrinone).

  • Original Dataset: 293 high-resolution (2752x2208) 8-bit images.
  • Augmented Dataset 1: 1,172 images created by splitting the originals into four quadrants.
  • Augmented Dataset 2: 4,688 images generated by rotating the quadrant images by 90, 180, and 270 degrees.

This scaling allowed the researchers to observe how model performance improved as the volume of training data increased.

Key Insights and Ideas

  • The Power of Skip Connections: The U-Net’s ability to "shortcut" information across the network proved vital. While FCNs struggled to restore spatial details from compressed "latent" representations, U-Net’s architecture retained the fine-grained edge data necessary to separate clumped platelets.
  • Data Scaling is King: One of the most significant "aha" moments was the direct correlation between dataset size and performance. Moving from 293 to 4,688 images pushed the Dice coefficient from a respectable 0.90 to a near-flawless 0.99.
  • Efficiency in Architecture: By using a four-layer module instead of the standard five, the researchers met the segmentation requirements while avoiding "excessive parameters," making the model more efficient to train without sacrificing accuracy.
  • FCN’s Limitations: The FCN model was abandoned early for larger datasets because it failed to produce reliable cell counts (resulting in a Mean Percentage Error of 55.44%), highlighting that not all "fully convolutional" models are created equal for medical segmentation.

Key Results

The quantitative gap between the two models was stark:

  • Small Dataset (293 images): U-Net achieved a Dice score of 0.90 and 0.96 accuracy, while FCN lagged behind with a 0.60 Dice score and 0.81 accuracy.
  • Large Dataset (4,688 images): U-Net reached a 0.99 Dice score, 0.99 IoU (Intersection over Union), and 0.98 accuracy.
  • Uncertainty: The model’s 95% confidence interval captured over 80% of the ground-truth counts, demonstrating high reliability.
  • Speed: Despite the complexity, training on the largest dataset took approximately 105 minutes on consumer-grade hardware (Intel i5-12400), making it accessible for standard lab environments.

Limitations and Future Work

The authors identified several hurdles that still need to be cleared:

  • Out-of-Focus Images: The current dataset lacks foreground masks for out-of-focus images, which hinders counting performance in less-than-ideal imaging setups.
  • Extreme Overlap: While U-Net handled clumping well, extremely overlapping cells remain a challenge even for human experts. The authors suggest that incorporating the original image as a supplementary input to the counting network might help.
  • Annotation Bias: The study relied on automated binarization for ground truth labels. While effective here, this can introduce labeling bias. Future work could involve "active label cleaning" to improve dataset quality under resource constraints.
  • Generalization: The models often struggle to generalize across different imaging setups without retraining, a common "brittleness" in deep learning that requires further research into domain adaptation.

Summary updated

Abstract

Manual counting of platelets, in microscopy images, is greatly time-consuming. Our goal was to automatically segment and count platelets images using a deep learning approach, applying U-Net and Fully Convolutional Network (FCN) modelling. Data preprocessing was done by creating binary masks and utilizing supervised learning with ground-truth labels. Data augmentation was implemented, for improved model robustness and detection. The number of detected regions was then retrieved as a count. The study investigated the U-Net models performance with different datasets, indicating notable improvements in segmentation metrics as the dataset size increased, while FCN performance was only evaluated with the smaller dataset and abandoned due to poor results. U-Net surpassed FCN in both detection and counting measures in the smaller dataset Dice 0.90, accuracy of 0.96 (U-Net) vs Dice 0.60 and 0.81 (FCN). When tested in a bigger dataset U-Net produced even better values (Dice 0.99, accuracy of 0.98). The U-Net model proves to be particularly effective as the dataset size increases, showcasing its versatility and accuracy in handling varying cell sizes and appearances. These data show potential areas for further improvement and the promising application of deep learning in automating cell segmentation for diverse life science research applications.
BibTeX
@misc{sousa2024u,
  author = {Eva Maria Valerio de Sousa and Ajay Kumar and Charlie Coupland and Tânia F. Vaz and Will Jones and Rubén Valcarce-Diñeiro and Simon D. J. Calaminus},
  title = {{U-Net as a deep learning-based method for platelets segmentation in microscopic images}},
  year = {2024},
  doi = {10.1101/2024.08.23.24312502},
  howpublished = {medRxiv},
}
Figure