ACP-BC: A Model for Accurate Identification of Anticancer Peptides Based on Fusion Features of Bidirectional Long Short-Term Memory and Chemically Derived Information

Mingwei Sun, Haoyuan Hu, Wei Pang, You ZhouInternational Journal of Molecular Sciences 2023 · OpenReview

TL;DR

This paper introduces ACP-BC, a novel deep learning model that significantly improves the identification of anticancer peptides (ACPs) by fusing sequence-based features with chemically derived information. By employing a three-channel architecture incorporating Bi-LSTM, a chemical-aware BERT model, and traditional feature engineering, ACP-BC achieves state-of-the-art accuracy, paving the way for more efficient discovery of potential cancer therapeutics.

What Problem Does This Paper Address?

Cancer remains a major global health challenge, and while traditional treatments like chemotherapy and radiation have limitations, anticancer peptides (ACPs) offer a promising alternative due to their high specificity and low toxicity. However, experimentally identifying these peptides is a laborious, time-consuming, and expensive process. Computational methods have emerged to accelerate this discovery, but existing approaches often struggle with accuracy, particularly when dealing with the complex nature of peptide sequences and the need to capture subtle biological signals. This paper aims to bridge this gap by developing a more accurate and robust computational model for ACP identification.

Methods

The core of the ACP-BC model is its innovative three-channel architecture designed to extract diverse features from peptide sequences:

  • Channel 1: Bidirectional Long Short-Term Memory (Bi-LSTM): This channel processes the raw amino acid sequence. After an initial embedding layer, a Bi-LSTM network captures sequential dependencies from both forward and backward directions, effectively learning contextual information within the peptide.
  • Channel 2: Chemical BERT: This is a novel contribution. The peptide sequence is first converted into a chemical molecular formula and then simplified using Simplified Molecular Input Line Entry System (SMILES) notation. This SMILES representation is then fed into a pre-trained BERT model (specifically, chemBERTa, which is trained on molecular SMILES data) for fine-tuning. This allows the model to learn deep abstract features related to the chemical properties of the peptides.
  • Channel 3: Manually Crafted Features: This channel incorporates established and effective feature engineering techniques, including:
  • Binary Profile Feature (BPF)
    • Dipeptide Composition (DPC)
    • Pseudo Amino Acid Composition (PAAC)
    • K-mer Sparse Matrix

These features capture different aspects of the peptide sequence, such as amino acid composition, local arrangements, and physicochemical properties.

Finally, the features extracted from these three channels are concatenated and fed into a fully connected layer for classification, determining whether a peptide is an ACP or not. The model also utilizes data augmentation techniques (random replacement, shuffling, reversal, and subsampling) to improve robustness and generalization.

Datasets

The study utilizes several well-established datasets for training and evaluation:

  • Training/Testing Datasets:
    • ACP740: A dataset with 364 positive (ACP) and 376 negative (non-ACP) samples.
  • ACP240: A dataset with 129 positive and 111 negative samples.
  • Independent Validation Datasets:
    • ACP164: Used to validate generalization ability.
  • ACPred-Fuse: A dataset with a large number of negative samples, designed to simulate real-world scenarios and test the model's ability to mine deep abstract features.
  • ACP20: A small dataset (10 ACPs, 10 non-ACPs) used to assess robustness.

Key Insights and Ideas

  • Fusion is Key: The paper strongly advocates for the power of fusing diverse feature types. Combining sequential, chemical, and traditional bioinformatic features leads to a more comprehensive understanding of peptide properties than any single feature type alone.
  • Chemical Information Matters: Introducing chemically derived features, particularly through a BERT model trained on SMILES, is a novel and effective approach. This allows the model to capture information beyond just the amino acid sequence, potentially revealing hidden relationships relevant to anticancer activity.
  • BERT's Adaptability: The successful application of a pre-trained BERT model (chemBERTa) to molecular SMILES data demonstrates the versatility of transformer architectures beyond natural language processing, extending their utility to chemical and biological sequence analysis.
  • Data Augmentation's Impact: Even simple data augmentation techniques, when applied thoughtfully, can significantly improve model performance and generalization, especially on smaller datasets.

Key Results

  • State-of-the-Art Performance: ACP-BC achieved impressive accuracy: 87% on ACP740 and 90% on ACP240. These results represent improvements of 1.3% and 7%, respectively, over existing state-of-the-art methods on these datasets.
  • Robustness on Small Datasets: The model demonstrated strong performance on the small ACP20 dataset, accurately identifying all 10 ACP samples and 10 non-ACP samples.
  • Improved Metrics: Beyond accuracy, ACP-BC showed competitive or superior performance across other key metrics like Matthews Correlation Coefficient (MCC), Sensitivity (SE), and Specificity (SP) when compared to existing methods.
  • Effective Feature Fusion: Ablation studies indicated that combining the three channels of features (Bi-LSTM, Chemical BERT, and handcrafted features) yielded better results than using individual channels or simpler combinations.

Limitations and Future Work

  • Dataset Limitations: The authors acknowledge that the performance might be affected by dataset biases or the unique nature of some anticancer peptides, which can be difficult for the model to identify. They suggest that incorporating more diverse datasets could help.
  • Model Improvement: While the model shows high accuracy, there's still room for improvement in accurately extracting more effective and recognizable features.
  • Future Directions: The authors plan to:
  • Introduce more complex and effective features.
  • Explore new machine learning methods, such as contrastive learning, to mitigate the impact of imbalanced or unique samples.
  • Develop an intelligent system for accurate ACP identification by deploying the model.

Summary updated

Abstract

Anticancer peptides (ACPs) have been proven to possess potent anticancer activities. Although computational methods have emerged for rapid ACPs identification, their accuracy still needs improvement. In this study, we propose a model called ACP-BC, a three-channel end-to-end model that utilizes various combinations of data augmentation techniques. In the first channel, features are extracted from the raw sequence using a bidirectional long short-term memory network. In the second channel, the entire sequence is converted into a chemical molecular formula, which is further simplified using Simplified Molecular Input Line Entry System notation to obtain deep abstract features through a bidirectional encoder representation transformer (BERT). In the third channel, we manually selected four effective features according to dipeptide composition, binary profile feature, k-mer sparse matrix, and pseudo amino acid composition. Notably, the application of chemical BERT in predicting ACPs is novel and successfully integrated into our model. To validate the performance of our model, we selected two benchmark datasets, ACPs740 and ACPs240. ACP-BC achieved prediction accuracy with 87% and 90% on these two datasets, respectively, representing improvements of 1.3% and 7% compared to existing state-of-the-art methods on these datasets. Therefore, systematic comparative experiments have shown that the ACP-BC can effectively identify anticancer peptides.
BibTeX
@article{sun2023acp,
  author = {Mingwei Sun and Haoyuan Hu and Wei Pang and You Zhou},
  title = {{ACP-BC: A Model for Accurate Identification of Anticancer Peptides Based on Fusion Features of Bidirectional Long Short-Term Memory and Chemically Derived Information}},
  journal = {International Journal of Molecular Sciences},
  year = {2023},
  url = {https://openreview.net/forum?id=cED9SZ3SSJ},
}
Figure