iNP_ESM: Neuropeptide Identification Based on Evolutionary Scale Modeling and Unified Representation Embedding Features

Honghao Li, Liangzhen Jiang, Kaixiang Yang, Shulin Shang, Mingxin Li, Zhibin LvInternational Journal of Molecular Sciences 2024 · DOI

TL;DR

This paper introduces iNP_ESM, a novel machine learning model for identifying neuropeptides. By combining two powerful protein language models (ESM and UniRep) and employing advanced feature fusion and selection techniques, iNP_ESM achieves state-of-the-art accuracy in predicting neuropeptides, paving the way for better understanding of neurological functions and diseases.

What Problem Does This Paper Address?

Neuropeptides are vital signaling molecules in the nervous system, playing critical roles in everything from mood regulation to tissue repair. However, accurately identifying them is a significant challenge. Traditional methods are often costly, time-consuming, and require specialized expertise. While machine learning has shown promise, existing models face limitations such as a lack of comprehensive features, potential redundancy, and a need for improved interpretability. This paper aims to bridge this gap by developing a more accurate, efficient, and robust machine learning model for neuropeptide identification.

Methods

The core of the iNP_ESM model lies in its innovative approach to feature extraction and model optimization:

  • Protein Language Models (PLMs): The researchers leverage two pre-trained PLMs:
  • Evolutionary Scale Modeling (ESM): This model, trained on billions of protein sequences, generates 1280-dimensional feature vectors that capture evolutionary and structural information.
  • Unified Representation (UniRep): This model, also trained on a vast corpus of protein sequences, produces 1900-dimensional feature vectors, focusing on capturing the sequential and functional attributes of proteins.
  • Feature Fusion: To harness the complementary strengths of ESM and UniRep, their respective feature vectors are concatenated, creating a richer, 3180-dimensional representation of neuropeptide sequences.
  • Feature Selection: Recognizing that high dimensionality can sometimes hinder performance, the researchers employ a feature selection strategy. Using the LGBM algorithm's feature importance ranking, they systematically reduce the feature set, ultimately identifying an optimal 120-dimensional representation.
  • Support Vector Machine (SVM): The final classification is performed using an SVM algorithm, chosen for its strong performance with the fused and selected features.
  • UMAP Visualization: To validate the effectiveness of their optimization strategies, the researchers use Uniform Manifold Approximation and Projection (UMAP) to visualize the data in a lower-dimensional space, demonstrating improved clustering of neuropeptide features.

Datasets

The study utilizes the NeuroPep 2.0 dataset, which is described as the latest and most comprehensive dataset for neuropeptide research, containing over 11,000 unique neuropeptide records. For training, they filtered sequences to be between 5 and 100 amino acids and used CD-HIT to remove highly similar sequences (over 90% similarity), resulting in 4463 neuropeptides. For independent testing, 10% of the NeuroPep 2.0 additions (444 neuropeptides) were used. Negative instances (non-neuropeptides) were sourced from UniProt with similar length distributions to positive examples, with 444 randomly selected for the test set.

Key Insights and Ideas

  • Synergy of PLMs: The fusion of ESM and UniRep features significantly outperforms individual models, highlighting that different PLMs capture distinct, complementary information about protein sequences.
  • Dimensionality Reduction is Key: While raw fused features are powerful, aggressive feature selection (reducing to 120 dimensions) is crucial for achieving peak performance and robustness, suggesting that not all extracted features are equally informative.
  • Visualization as a Validation Tool: UMAP visualization effectively demonstrates how feature fusion and selection improve the model's ability to distinguish neuropeptides from non-neuropeptides, offering a visual confirmation of improved feature representation.
  • SVM's Continued Relevance: Despite the rise of deep learning, SVM remains a highly effective classifier when paired with well-engineered features, especially in this context.

Key Results

The iNP_ESM model demonstrates impressive performance:

  • Cross-validation: Achieved an accuracy (ACC) of up to 0.937, a Matthews Correlation Coefficient (MCC) of up to 0.873, and an F1 score of up to 0.934.
  • Independent Testing: Reached an ACC of up to 0.928, an MCC of up to 0.856, and an F1 score of up to 0.928.
  • Comparison to State-of-the-Art: iNP_ESM (specifically the 120D version) outperformed the previous leading model, NeuroPred-PLM, in several key metrics, including ACC, MCC, and precision, on both cross-validation and independent test sets.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Dataset Size and Quality: While NeuroPep 2.0 is a significant improvement, the availability of even larger and more diverse neuropeptide datasets would further enhance model accuracy and generalizability.
  • Interpretability: The interpretability of deep learning models, including PLMs, remains a challenge. Future work should focus on developing more transparent methodologies to understand the biological significance of the predictive features.
  • Feature Reduction Trade-offs: While feature selection improved performance, the authors note that reducing dimensionality might slightly decrease adaptability to entirely new data due to the loss of some features. Finding an optimal balance between feature reduction and predictive efficiency is an ongoing area of exploration.
  • Broader Applications: The authors believe iNP_ESM has potential for broader applications in research and clinical treatment of neurological diseases, suggesting future work could explore these avenues.

Summary updated

Abstract

Neuropeptides are biomolecules with crucial physiological functions. Accurate identification of neuropeptides is essential for understanding nervous system regulatory mechanisms. However, traditional analysis methods are expensive and laborious, and the development of effective machine learning models continues to be a subject of current research. Hence, in this research, we constructed an SVM-based machine learning neuropeptide predictor, iNP_ESM, by integrating protein language models Evolutionary Scale Modeling (ESM) and Unified Representation (UniRep) for the first time. Our model utilized feature fusion and feature selection strategies to improve prediction accuracy during optimization. In addition, we validated the effectiveness of the optimization strategy with UMAP (Uniform Manifold Approximation and Projection) visualization. iNP_ESM outperforms existing models on a variety of machine learning evaluation metrics, with an accuracy of up to 0.937 in cross-validation and 0.928 in independent testing, demonstrating optimal neuropeptide recognition capabilities. We anticipate improved neuropeptide data in the future, and we believe that the iNP_ESM model will have broader applications in the research and clinical treatment of neurological diseases.
BibTeX
@article{li2024inp,
  author = {Honghao Li and Liangzhen Jiang and Kaixiang Yang and Shulin Shang and Mingxin Li and Zhibin Lv},
  title = {{iNP\_ESM: Neuropeptide Identification Based on Evolutionary Scale Modeling and Unified Representation Embedding Features}},
  journal = {International Journal of Molecular Sciences},
  year = {2024},
  doi = {10.3390/ijms25137049},
}
Figure