Ensembling Unets, sparse representation and low dimensional visualization for rare chromosomal aberration detection in light microscopy images

Antonin Deschemps, Eric Grégoire, Juan S. Martinez, Aurélie Vaurijoux, Pascale Fernandez, Delphine Dugué, Laure Bobyk, Marco Túlio Valente, Gaëtan Gruel, Emmanuel Moebel, Mohamed Amine Benadjaoud, Charles KervrannbioRxiv 2023 · DOI

TL;DR

This paper introduces a novel deep learning approach for automatically detecting and identifying rare chromosomal aberrations in microscopy images, a crucial step in biological dosimetry. By combining a sparse-representation-aware Unet with an ensemble of model checkpoints and a PCA-based visualization technique, they achieve significant improvements in precision and recall compared to existing methods, paving the way for more efficient and reliable radiation dose estimation.

What Problem Does This Paper Address?

Estimating radiation dose after an exposure event often relies on counting chromosomal aberrations in peripheral blood lymphocytes. This is a tedious and time-consuming manual process because identifying these rare events in microscopy images is challenging. Conventional computer vision struggles with the variability in chromosome appearance (spread, illumination, etc.), leading to high and inconsistent false detection rates. This makes fully automated analysis difficult, hindering timely diagnosis and precise dose estimation. The paper aims to automate this process, reducing diagnosis time and improving the confidence intervals for radiation dose estimations.

Methods

The authors propose a multi-faceted approach:

  • Unet-based Heatmap Regression: They employ a Unet architecture, a popular choice for image segmentation, to predict a heatmap indicating the probability of an aberration at each pixel. This is framed as a keypoint regression task.
  • Sparsity-Promoting Loss: To address the rarity of aberrations, they introduce a sparsity-promoting regularizer in the loss function. This encourages the model to produce sparse "hotspot" predictions, effectively reducing false alarms.
  • Ensembling Checkpoints: Instead of training multiple models from scratch, they leverage the stochastic nature of Stochastic Gradient Descent (SGD) during a single training run. By collecting checkpoints at the end of each epoch, they create an ensemble of models. This "implicit ensembling" is shown to be effective in improving robustness and reducing performance variation.
  • PCA-based Visualization: To understand the model's behavior and the benefits of ensembling, they use Principal Component Analysis (PCA) to visualize the latent feature space of the Unet. This allows them to track how different classes (dicentrics, fragments, background) separate during training and to interpret the model's decision-making process.

Datasets

  • Training Dataset: A large, annotated dataset of 5430 images was used for training. This dataset is characterized by an over-representation of images containing aberrations, reflecting a high radiation dose scenario.
  • Calibration Curve Dataset: A separate dataset of 21215 metaphases, irradiated at specific known doses (0 Gy to 4 Gy), was used for estimating calibration curves. This dataset is not annotated for aberrations, simulating a more realistic scenario where aberrations are rare.

Key Insights and Ideas

  • Sparsity is Key for Rare Events: Directly incorporating sparsity into the loss function is crucial for effectively detecting rare events like chromosomal aberrations, significantly reducing false positives.
  • Implicit Ensembling is Powerful: Leveraging checkpoints from a single training run, rather than training multiple independent models, is a computationally efficient way to achieve robust performance and reduce uncertainty in predictions. This suggests that the training process itself explores a diverse enough parameter space.
  • Visualization Unlocks Understanding: PCA-based visualization of the model's latent space provides valuable insights into how the model learns to discriminate between different classes and how ensembling contributes to improved performance and robustness. It also helps in understanding the model's decision boundaries and areas of uncertainty.
  • Domain Knowledge Enhances Calibration: While the model is trained on an imbalanced dataset, incorporating domain knowledge (e.g., the co-occurrence of dicentrics and fragments) and using model-adaptive thresholding significantly improves the accuracy of calibration curves for dose estimation.

Key Results

  • Improved Precision and Recall: The proposed ensemble method significantly outperforms a single Unet model and the commercial solution Metafer in terms of both Precision and Recall for detecting dicentric chromosomes and fragments. For example, the ensemble achieved a Precision of 85.8% and Recall of 61.7% for dicentrics, compared to Metafer's approximate 40% Precision and 35% Recall.
  • Reduced Performance Variation: Ensembling multiple checkpoints leads to more stable performance, with lower inter-quantile intervals compared to single models, making the system more reliable for deployment.
  • Automated Calibration: The ensemble approach, combined with domain knowledge, allows for a fully automated calibration curve estimation, outperforming semi-automated methods like Metafer which require manual review.
  • Robustness to Debris: Feature visualization suggests that the Unet model learns to reject non-chromosome objects like nuclei and debris without explicit annotations or specialized architectural choices.

Limitations and Future Work

  • Dataset Imbalance: The training dataset is highly imbalanced, with a significant over-representation of images containing aberrations. While the authors show their method can still perform well on realistic data, this imbalance might contribute to some spurious detections.
  • Underestimation of Doses: The model's recall is not perfect, meaning some aberrations might be missed. This can lead to an underestimation of radiation doses, especially at higher exposure levels.
  • Future Work: The authors suggest further exploration of visualization techniques and potentially architectural modifications to improve recall. They also highlight the potential for building competitive aberration detection systems even with significant distribution gaps between training and inference data.

Summary updated

Abstract

A bstract In biological dosimetry, a radiation dose is estimated using the average number of chromosomal aberration per peripheral blood lymphocytes. To achieve an adequate precision in the estimation of this average, hundreds of cells must be analyzed in 2D microscopy images. Currently, this analysis is performed manually, as conventional computer vision techniques struggle with the wide variety of shapes showcased by chromosomes. The false discovery rate of current automated detection systems is high and variable, depending on small variations in data quality (chromosome spread, illumination variations …), which makes using it in a fully automated fashion impossible. Automating chromosomal aberration is needed to reduce diagnosis time. Furthermore, an automated system can process more images, which improves confidence intervals around the estimated radiation dose. We build an object detection model to automate chromosomal aberration detection using recent advances in deep convolutional neural networks and statistical learning. We formulated the problem of rare aberration detection as a heatmap regression problem requiring the minimization of a sparsity-promoting loss to reduce the false alarm rate. Our Unet-based approach is analoguous to a one-stage object detector, and keeps the number of hyperparameters to a minimum. Finally, we demonstrate large performance improvements using an ensemble of checkpoints collected during a single run of training. A PCA-based strategy is used to provide cues for interpretation of our deep neural network-based model. The methodology is demonstrated on real, large, and challenging datasets depicting rare chromosomal aberrations and is favorably compared to a reference dosimetry technique.
BibTeX
@misc{deschemps2023ensembling,
  author = {Antonin Deschemps and Eric Grégoire and Juan S. Martinez and Aurélie Vaurijoux and Pascale Fernandez and Delphine Dugué and Laure Bobyk and Marco Túlio Valente and Gaëtan Gruel and Emmanuel Moebel and Mohamed Amine Benadjaoud and Charles Kervrann},
  title = {{Ensembling Unets, sparse representation and low dimensional visualization for rare chromosomal aberration detection in light microscopy images}},
  year = {2023},
  doi = {10.1101/2023.09.11.557124},
  howpublished = {bioRxiv},
}
Figure