Mitosis Detection from Partial Annotation by Dataset Generation via Frame-Order Flipping

Kazuya Nishimura, Ami Katanaya, Shinichiro Chuma, Ryoma Bise

Abstract

Detection of mitosis events is a cornerstone of biomedical research, yet deep-learning-based detection methods are often limited by the high cost of manual annotation. In many practical scenarios, researchers only have access to "partial annotations," where some events are labeled but many others are missed. This paper proposes a novel framework to address this by generating a fully labeled synthetic dataset from partially labeled sequences. The core of the approach involves Frame-Order Flipping (FOF) to create guaranteed negative samples and Alpha-Blending Pasting (ABP) to augment the dataset with known mitosis events. Experimental results across four distinct datasets demonstrate that this method significantly outperforms existing partial-label learning techniques, particularly in low-data regimes.

Introduction

Tracking cell division (mitosis) in time-lapse microscopy is essential for understanding cell proliferation, drug efficacy, and developmental biology. While deep learning models have shown great promise in automating this task, they typically require exhaustive annotations. In practice, human annotators often miss events in long, complex videos, leading to datasets where "unlabeled" regions are ambiguous: they might contain a true negative (no mitosis) or a missed positive (unlabeled mitosis).

Standard supervised learning fails in this context because it treats all unlabeled regions as negatives. This penalizes the model for correctly identifying missed mitosis events, leading to a significant drop in detection performance. To overcome this, we propose a method that synthesizes a reliable, fully labeled training set from these sparse inputs.

Methodology

The proposed framework transforms a partially labeled dataset into a fully labeled one using two primary techniques:

1. Frame-Order Flipping (FOF)

To train a robust detector, the model needs guaranteed negative examples—regions where mitosis is definitely not occurring. The authors introduce Frame-Order Flipping, which reverses the temporal order of consecutive frames. Because mitosis is a biologically directional process (one cell splitting into two), reversing the frames creates a "fusion" event (two cells merging into one). This reversed sequence maintains the natural background noise, cell density, and motion dynamics of the original microscopy data but is biologically impossible as a mitosis event. These flipped pairs serve as perfect synthetic negatives.

2. Alpha-Blending Pasting (ABP)

Once a set of negative frames is generated via FOF, the method populates them with known mitosis events extracted from the sparse labels. To prevent the model from learning "shortcuts"—such as detecting the sharp rectangular edges of a pasted crop rather than the biological features of the cell—the authors use alpha-blending. By applying a Gaussian mask to the edges of the mitosis crop, the event is seamlessly integrated into the negative background. This ensures the U-Net-based heatmap detector focuses on the internal structural changes of the dividing cell.

Experimental Results

The method was evaluated on four fluorescent microscopy datasets: HeLa (human cancer cells), ES (mouse embryonic stem cells), ES-D (differentiated stem cells), and Fib (mouse fibroblast cells).

Performance in Data-Scarce Scenarios

The framework showed remarkable strength when training data was extremely limited:

  • 1-Shot Learning: Using only a single annotated sequence, the proposed method achieved an average F1-score of 0.553, nearly doubling the performance of the baseline (0.308).
  • 5-Shot Learning: The method reached an F1-score of 0.610, significantly outperforming standard Positive-Unlabeled (PU) learning techniques (0.459).

Ablation Study

To confirm the impact of the "time-reversal" logic, the authors conducted an ablation study. Removing the FOF component caused the F1-score to plummet from 0.795 to 0.570, confirming that the generation of high-quality negatives is the primary driver of the model's accuracy.

Discussion and Conclusion

The primary insight of this work is the utilization of temporal symmetry to solve a biological labeling problem. By recognizing that reversed mitosis is a non-event that still looks like "real" data, the authors provide a way to generate infinite negative samples.

However, some limitations remain. The FOF technique is specific to one-way temporal events; it may not be applicable to biological processes that appear similar when reversed. Additionally, while the method is highly effective for 2D fluorescent images, future work is needed to adapt these augmentation strategies for 3D confocal data or phase-contrast microscopy, where cell boundaries are less distinct. Despite these challenges, this framework represents a significant step toward making deep-learning-based cell analysis accessible for researchers with limited annotation resources.

Summary updated

Abstract

Detection of mitosis events plays an important role in biomedical research. Deep-learning-based mitosis detection methods have achieved outstanding performance with a certain amount of labeled data. However, these methods require annotations for each imaging condition. Collecting labeled data involves time-consuming human labor. In this paper, we propose a mitosis detection method that can be trained with partially annotated sequences. The base idea is to generate a fully labeled dataset from the partial labels and train a mitosis detection model with the generated dataset. First, we generate an image pair not containing mitosis events by frame-order flipping. Then, we paste mitosis events to the image pair by alpha-blending pasting and generate a fully labeled dataset. We demonstrate the performance of our method on four datasets, and we confirm that our method outperforms other comparisons which use partially labeled sequences.
BibTeX
@inproceedings{nishimura2023mitosis,
  author = {Kazuya Nishimura and Ami Katanaya and Shinichiro Chuma and Ryoma Bise},
  title = {{Mitosis Detection from Partial Annotation by Dataset Generation via Frame-Order Flipping}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2023},
  url = {https://openreview.net/forum?id=CV4YziNeQd},
}
Figure