Deep Learning-Based Strategy For Macromolecules Classification with Imbalanced Data from Cellular Electron Cryotomography

Ziqian Luo, Xiangrui Zeng, Zhipeng Bao, Min Xu

TL;DR

This paper introduces a novel deep learning strategy to classify 3D macromolecular complexes captured by Cellular Electron Cryotomography (Cryo-ET), a domain notoriously plagued by extreme data imbalance. By combining a custom "multi-path" Convolutional Neural Network (CNN) with mixup data augmentation and focal loss, the authors successfully prevent majority classes from dominating the model, significantly outperforming traditional imbalanced learning techniques.

What Problem Does This Paper Address?

Cellular Electron Cryotomography (Cryo-ET) is a cutting-edge imaging technique that provides high-resolution, 3D visualizations of cellular structures in their near-native states. It is a powerful tool for discovering and analyzing macromolecular complexes inside single cells.

However, biological reality presents a massive data science challenge: protein concentrations within a cell can vary by up to seven orders of magnitude. Consequently, Cryo-ET datasets are inherently and severely imbalanced. Standard deep learning classifiers trained on this data tend to heavily favor the majority classes (the abundant proteins) and ignore the minority classes (the rare proteins), leading to poor overall predictive performance. While the computer vision community has developed methods for imbalanced data, they are rarely applied to internal tissue classification of cell macromolecules.

Methods

To tackle this extreme imbalance, the authors move beyond standard resampling techniques and propose a three-pronged deep learning approach:

  1. Multi-Path CNN Architecture: Inspired by the Inception 3D network, the authors designed a CNN with multiple parallel paths. The number of paths equals the number of classes in the dataset. During training, the multi-class problem is essentially degenerated into several binary classification problems. Each path is optimized to become an "expert" at identifying one specific class. The features from all paths are then concatenated and passed through a pooling layer and a softmax function for the final multi-class decision.
  2. Mixup Data Augmentation: To expand the training distribution and prevent overfitting on minority classes, the authors use mixup. This technique creates virtual training examples by taking linear interpolations of pairs of input images and their corresponding one-hot labels.
  3. Focal Loss: Instead of standard cross-entropy, the model uses an $\alpha$-balanced focal loss. This reshapes the loss function to down-weight easy, well-classified examples (usually from the majority class) and forces the network to focus on hard, misclassified examples (usually from the minority classes).

The authors rigorously compared their proposed architecture against traditional imbalanced data strategies, including SMOTE (Synthetic Minority Over-sampling Technique), undersampling, bagging, boosting, and Genetic Programming (GP).

Datasets

The model was evaluated on a real-world Cryo-ET dataset extracted from a tomogram of a rat neuron expressing a poly-GA aggregate. The dataset contains 3D subtomograms (binned to $40^3$ voxels) of four types of macromolecules, showcasing a stark class imbalance:

  • Double-capped proteasome (proteasome_d): 1043 samples (63.5%)
  • Single-capped proteasome (proteasome_s): 386 samples (23.5%)
  • TRiC (TCP-1 ring complex): 125 samples (7.6%)
  • Ribosome: 80 samples (4.9%)

The dataset was split into 1307 training samples and 327 testing samples.

Key Insights and Ideas

  • Architectural Specialization Beats Generic Resampling: Traditional sampling methods like SMOTE or undersampling can lead to overfitting or the loss of valuable data, respectively. By dedicating a specific CNN path to each class, the network is forced to learn the distinct features of minority classes without those features being drowned out by the majority class during gradient descent.
  • Synergy of Data, Loss, and Architecture: The best results weren't achieved by a single silver bullet, but by combining interventions at three levels: the data level (mixup), the loss level (focal loss), and the architectural level (multi-path CNN).
  • Metrics Matter: The authors rightly point out that standard "accuracy" is a deceptive metric for imbalanced data (a model could just guess the majority class and score 63.5%). They instead rely on Macro F1-Score and Macro G-mean to ensure the model is evaluated on its balanced performance across all classes.

Key Results

  • The proposed Multi-path CNN + mixup + focal loss achieved the best overall performance, yielding a Macro F1 score of 73.6 and a Macro G-mean of 84.7.
  • This significantly outperformed traditional baseline classifiers like Granular Support Vector Machine with Repetitive Undersampling (GSVM-RU), which scored a Macro F1 of 69.5 and a Macro G-mean of 80.3.
  • The proposed method also beat out combinations of the Multi-path CNN with older techniques. For example, combining the Multi-path CNN with SMOTE and Genetic Programming yielded a lower Macro F1 of 72.6.
  • Ablation studies showed that the model is flexible; the authors successfully adjusted the number of paths to handle two-class and three-class versions of the dataset, consistently outperforming the GSVM-RU baselines.

Limitations and Future Work

  • Scalability of the Architecture: Because the multi-path CNN requires one distinct path per class, the size and computational cost of the model scale linearly with the number of classes. While effective for a 4-class problem, this could become computationally expensive for datasets with dozens or hundreds of macromolecule types.
  • Future Work: The authors plan to extend this framework to tackle broader issues in computational biology and bio-related technologies, aiming to promote the development of more robust tools for analyzing complex, real-world biological imaging data.

Summary updated

Abstract

Deep learning model trained by imbalanced data may not work satisfactorily since it could be determined by major classes and thus may ignore the classes with small amount of data. In this paper, we apply deep learning based imbalanced data classification for the first time to cellular macromolecular complexes captured by Cryo-electron tomography (Cryo-ET). We adopt a range of strategies to cope with imbalanced data, including data sampling, bagging, boosting, Genetic Programming based method and. Particularly, inspired from Inception 3D network, we propose a multi-path CNN model combining focal loss and mixup on the Cryo-ET dataset to expand the dataset, where each path had its best performance corresponding to each type of data and let the network learn the combinations of the paths to improve the classification performance. In addition, extensive experiments have been conducted to show our proposed method is flexible enough to cope with different number of classes by adjusting the number of paths in our multi-path model. To our knowledge, this work is the first application of deep learning methods of dealing with imbalanced data to the internal tissue classification of cell macromolecular complexes, which opened up a new path for cell classification in the field of computational biology.
BibTeX
@inproceedings{luo2019deep,
  author = {Ziqian Luo and Xiangrui Zeng and Zhipeng Bao and Min Xu},
  title = {{Deep Learning-Based Strategy For Macromolecules Classification with Imbalanced Data from Cellular Electron Cryotomography}},
  booktitle = {IJCNN},
  year = {2019},
  url = {https://openreview.net/forum?id=xvMwDXvaVzv},
}

Loading related content...

Figure