Segmentation of Drug‐Treated Cell Image and Mitochondrial‐Oxidative Stress Using Deep Convolutional Neural Network

Awais Khan Nawabi, Jinfang Sheng, Rashid Abbasi, Muhammad Shahid Iqbal, Md Belal Bin Heyat, Faijan Akhtar, Kaishun Wu, Baidenger Agyekum TwumasiOxidative 2022 · DOI

TL;DR

This paper introduces a novel deep learning approach, DNDIS, for automatically segmenting mitochondrial cells, distinguishing between normal, drug-treated, and diseased states. By leveraging the ResNet-50 architecture, DNDIS achieves high precision in identifying these cellular conditions, offering a significant advancement over manual segmentation for drug development and disease diagnostics.

What Problem Does This Paper Address?

Accurately segmenting cell images is crucial for understanding cellular processes, especially in drug development and disease research. Manual segmentation is time-consuming, labor-intensive, and prone to inter-observer variability. While deep learning has shown promise in image analysis, there's a specific gap in automated methods for segmenting mitochondrial cells and differentiating between normal, drug-treated, and diseased states. This is particularly important for assessing the impact of new drugs and understanding oxidative stress, which is linked to various diseases and aging.

Methods

The core of this work is the Drug-Treated, Normal, and Diseased Image Segmentation (DNDIS) algorithm. DNDIS is built upon the ResNet-50 deep convolutional neural network (CNN) architecture. The method operates in two main stages:

  1. Detection: A deep detection model, also based on ResNet-50, is used to identify regions of interest (ROIs) containing potential drug-treated, diseased, or normal cells. This stage focuses on detecting the presence and location of these cellular states.
  2. Segmentation: Following detection, a segmentation model, again leveraging ResNet-50, refines the segmentation within the identified ROIs to produce a precise binary mask for each cell type.

The authors emphasize that their approach is fully automated, requiring no manual intervention or prior knowledge of cell shape. They also mention using a two-dimensional approach for training and testing, processing slices independently, and then employing a post-processing step (three-dimensional K-means) to ensure consistency and achieve a coherent 3D segmentation.

Datasets

The study utilized a dataset comprising 414 microscopic images. These images were categorized into three main types:

  • Drug-treated cells
  • Diseased cells
  • Normal mitochondrial cells

The paper mentions that the dataset is publicly available. While specific details on how the dataset was curated or if it represents a new benchmark are not extensively detailed, it's noted that the images were captured using confocal microscopy.

Key Insights and Ideas

  • Bridging the Gap in Specialized Segmentation: The paper highlights a significant gap in existing research: the lack of automated methods specifically for segmenting drug-treated, diseased, and normal mitochondrial cells simultaneously.
  • End-to-End Automation: The DNDIS method's fully automated nature is a key innovation, eliminating the need for manual annotation or prior knowledge of cell morphology, which is a major bottleneck in current practices.
  • ResNet-50 as a Robust Backbone: The successful application of ResNet-50 for both detection and segmentation underscores its versatility and effectiveness in complex biological image analysis tasks.
  • Mitochondrial Health as a Biomarker: The study reinforces the importance of mitochondrial health and oxidative stress as critical indicators for disease and drug efficacy, making accurate segmentation of these organelles vital.

Key Results

The DNDIS algorithm demonstrated strong performance across the tested datasets:

  • High Precision: The automated segmentation method achieved high precision rates of 90%, 92%, and 94% for the different cell categories.
  • Improved Performance: The proposed method outperformed existing techniques like SSDMT and LACM-BIC, particularly on drug-treated image datasets.
  • Reduced Manual Effort: The method significantly reduces the time and effort required for manual labeling, which is crucial for large-scale biological studies and clinical applications.
  • Effective Training: The study reports proper training of the deep learning model, with training and validation losses decreasing over epochs.

Limitations and Future Work

  • Dataset Size: While the dataset consists of 414 images, the authors acknowledge that limited datasets can be a constraint in medical imaging, potentially impacting the generalizability of deep learning models.
  • Two-Dimensional Processing: The training and testing were performed on two-dimensional slices, with a post-processing step to achieve 3D segmentation. While effective, a fully 3D convolutional approach might offer further improvements.
  • Future Directions: The authors suggest future work could involve creating new models for improved segmentation of mitochondrial, diseased, and drug-treated images, exploring cell image localization, drug effect analysis, and developing more advanced mitochondrial cell segmentation applications for measuring oxidative stress. They also aim to create new datasets for experiments.

Summary updated

Abstract

Most multicellular organisms require apoptosis, or programmed cell death, to function properly and survive. On the other hand, morphological and biochemical characteristics of apoptosis have remained remarkably consistent throughout evolution. Apoptosis is thought to have at least three functionally distinct phases: induction, effector, and execution. Recent studies have revealed that reactive oxygen species (ROS) and the oxidative stress could play an essential role in apoptosis. Advanced microscopic imaging techniques allow biologists to acquire an extensive amount of cell images within a matter of minutes which rule out the manual analysis of image data acquisition. The segmentation of cell images is often considered the cornerstone and central problem for image analysis. Currently, the issue of segmentation of mitochondrial cell images via deep learning receives increasing attention. The manual labeling of cell images is time-consuming and challenging to train a pro. As a courtesy method, mitochondrial cell imaging (MCI) is proposed to identify the normal, drug-treated, and diseased cells. Furthermore, cell movement (fission and fusion) is measured to evaluate disease risk. The newly proposed drug-treated, normal, and diseased image segmentation (DNDIS) algorithm can quickly segment mitochondrial cell images without supervision and further segment the highly drug-treated cells in the picture, i.e., normal, diseased, and drug-treated cells. The proposed method is based on the ResNet-50 deep learning algorithm. The dataset consists of 414 images mainly categorised into different sets (drug, diseased, and normal) used microscopically. The proposed automated segmentation method has outperformed and secured high precision (90%, 92%, and 94%); moreover, it also achieves proper training. This study will benefit medicines and diseased cell measurements in medical tests and clinical practices.
BibTeX
@inproceedings{nawabi2022segmentation,
  author = {Awais Khan Nawabi and Jinfang Sheng and Rashid Abbasi and Muhammad Shahid Iqbal and Md Belal Bin Heyat and Faijan Akhtar and Kaishun Wu and Baidenger Agyekum Twumasi},
  title = {{Segmentation of Drug‐Treated Cell Image and Mitochondrial‐Oxidative Stress Using Deep Convolutional Neural Network}},
  booktitle = {Oxidative},
  year = {2022},
  doi = {10.1155/2022/5641727},
}
Figure