ASPIRER: a new computational approach for identifying non-classical secreted proteins based on deep learning

Xiaoyu Wang, Fuyi Li, Jing Xu, Jia Rong, Geoffrey I. Webb, Zongyuan Ge, Jian Li, Jiangning Song

TL;DR

This paper introduces ASPIRER, a novel hybrid deep learning framework for identifying non-classical secreted proteins (NCSPs) in bacteria. By combining a whole-sequence XGBoost model with an N-terminal sequence-focused CNN, ASPIRER significantly outperforms existing methods, offering a more accurate and efficient tool for discovering these important proteins.

What Problem Does This Paper Address?

Proteins are the workhorses of cells, and their secretion is crucial for intercellular communication and various biological processes. Bacteria, especially Gram-positive ones, utilize sophisticated secretion systems to export proteins. While classical secretion pathways rely on specific signal peptides, a significant group of proteins, known as non-classical secreted proteins (NCSPs), are secreted without these canonical signals. The exact mechanisms governing NCSP secretion remain largely mysterious, making their identification challenging. Existing computational methods for predicting NCSPs often use the entire amino acid sequence, which can be problematic due to varying protein lengths and the fact that not all regions are equally important for secretion. Previous research suggests that specific regions, particularly the N- and C-termini, play critical roles in this process, but this has not been fully leveraged in prediction models. This paper aims to bridge this gap by developing a more accurate predictor that specifically considers the importance of N-terminal sequences.

Methods

ASPIRER employs a hybrid deep learning architecture, combining two distinct sub-models:

  • Whole Amino Acid Sequence-based XGBoost Model: This model uses handcrafted features extracted from the entire protein sequence. These features encompass amino acid composition (AAC), physicochemical properties, evolutionary information (Pse-PSSM), grouped AAC, and autocorrelation features. To manage high-dimensional data and improve performance, feature selection (using Chi-square test) and data balancing (using SMOTE) techniques were applied. XGBoost, a gradient boosting algorithm, was chosen for its robustness in handling complex datasets.
  • N-terminal Sequence-based Convolutional Neural Network (CNN) Model: Recognizing the importance of N-terminal regions, this model focuses on the first 60 amino acid residues. These residues are converted into dense vectors (embedding layer) and then processed by two 1D convolutional layers, followed by max-pooling layers. This CNN architecture is designed to automatically learn specific patterns within the N-terminal sequence that are indicative of NCSP secretion. Random oversampling was used to balance the dataset for this model.

The outputs from these two sub-models are then combined using a simple averaging scheme to generate the final prediction.

Datasets

The study utilized datasets collected from previous research, primarily from Zhang et al. [18].

  • Training Data: 157 positive (validated NCSPs) and 446 negative (cytoplasmic proteins) non-redundant samples were used.
  • Independent Test Data: This dataset was constructed by randomly selecting one-tenth of the NCSPs and experimentally validated NCSPs from previous studies and Zhang et al.'s work, with negative samples sourced from UniProt. The independent test dataset was the same as used in Zhang et al.'s work [18].

The source code and curated datasets are publicly available on GitHub.

Key Insights and Ideas

  • N-terminal regions are critical: The study strongly suggests that the N-terminal sequence of a protein contains crucial information for predicting non-classical secretion, more so than the C-terminal region. This insight directly informs the design of the ASPIRER model.
  • Hybrid approach yields superior results: Combining a whole-sequence feature-based model (XGBoost) with a local sequence-focused deep learning model (CNN) effectively captures both global protein characteristics and specific functional regions, leading to improved prediction accuracy.
  • Feature engineering still matters: While deep learning excels at automatic feature extraction (CNN), handcrafted features for the XGBoost model, combined with careful feature selection, proved highly effective.
  • Data balancing is essential: Techniques like SMOTE and random oversampling were crucial for addressing class imbalance and improving model robustness.

Key Results

ASPIRER demonstrated superior performance compared to existing state-of-the-art methods on both 5-fold cross-validation and independent tests.

  • Overall Performance: On the independent test, ASPIRER achieved an AUROC of 0.9533 and an AUPRC of 0.9444, outperforming other methods.
  • Comparison with State-of-the-Art: ASPIRER's AUROC was 6% higher than NonClasGP-Pred and 12% higher than PeNGaRoo. Its AUPRC was 3% higher than NonClasGP-Pred and 4% higher than PeNGaRoo.
  • Sub-model Performance: The final hybrid model consistently outperformed its individual XGBoost and CNN sub-models across multiple metrics, particularly AUROC and AUPRC.
  • N-terminal CNN: The CNN model trained on 60 N-terminal residues showed particularly strong performance, outperforming other settings and even handcrafted features from the same region.

Limitations and Future Work

  • Recall vs. AUROC/AUPRC: While ASPIRER excels in overall performance metrics like AUROC and AUPRC, its Recall was slightly lower than the whole-sequence XGBoost model. The authors attribute this to the integration of the N-terminal CNN, suggesting potential trade-offs.
  • Mechanism remains unclear: The paper focuses on prediction and does not fully elucidate the underlying biological mechanisms of NCSP secretion, which remains a complex area of research.
  • Future Directions: The authors anticipate ASPIRER will be a valuable tool for accelerating the discovery of novel NCSPs and guiding experimental validation. Further exploration of the N-terminal region's role and the integration of other sequence or structural features could lead to even more refined predictors. The availability of the code and datasets encourages further research and development in this area.

Summary updated

Abstract

Protein secretion has a pivotal role in many biological processes and is particularly important for intercellular communication, from the cytoplasm to the host or external environment. Gram-positive bacteria can secrete proteins through multiple secretion pathways. The non-classical secretion pathway has recently received increasing attention among these secretion pathways, but its exact mechanism remains unclear. Non-classical secreted proteins (NCSPs) are a class of secreted proteins lacking signal peptides and motifs. Several NCSP predictors have been proposed to identify NCSPs and most of them employed the whole amino acid sequence of NCSPs to construct the model. However, the sequence length of different proteins varies greatly. In addition, not all regions of the protein are equally important and some local regions are not relevant to the secretion. The functional regions of the protein, particularly in the N- and C-terminal regions, contain important determinants for secretion. In this study, we propose a new hybrid deep learning-based framework, referred to as ASPIRER, which improves the prediction of NCSPs from amino acid sequences. More specifically, it combines a whole sequence-based XGBoost model and an N-terminal sequence-based convolutional neural network model; 5-fold cross-validation and independent tests demonstrate that ASPIRER achieves superior performance than existing state-of-the-art approaches. The source code and curated datasets of ASPIRER are publicly available at https://github.com/yanwu20/ASPIRER/. ASPIRER is anticipated to be a useful tool for improved prediction of novel putative NCSPs from sequences information and prioritization of candidate proteins for follow-up experimental validation.
BibTeX
@article{wang2022aspirer,
  author = {Xiaoyu Wang and Fuyi Li and Jing Xu and Jia Rong and Geoffrey I. Webb and Zongyuan Ge and Jian Li and Jiangning Song},
  title = {{ASPIRER: a new computational approach for identifying non-classical secreted proteins based on deep learning}},
  journal = {Briefings in Bioinformatics},
  year = {2022},
  url = {https://openreview.net/forum?id=Y5DX9TPkHV},
}
Figure