GraphPI: Efficient Protein Inference with Graph Neural Networks

Zheng Ma, Jiazhen Chen, Lei Xin, Ali Ghodsi

TL;DR

This paper introduces GraphPI, a novel Graph Neural Network (GNN) framework for protein inference that tackles the challenge of limited labeled data by leveraging semi-supervised learning and self-training on public datasets. GraphPI achieves state-of-the-art performance and significantly improves computational efficiency compared to existing methods, making protein inference more accessible and scalable.

What Problem Does This Paper Address?

Accurately identifying proteins in biological samples is crucial for understanding biological systems and advancing fields like personalized medicine. This process, known as protein inference, relies on analyzing data from mass spectrometry experiments. However, a major bottleneck is the scarcity of extensively labeled datasets, which are expensive and complex to generate. Existing methods often require dataset-specific training, leading to overfitting and reduced computational efficiency. This paper aims to overcome these limitations by developing a more robust, efficient, and universally applicable protein inference framework.

Methods

GraphPI frames protein inference as a node classification problem within a tripartite graph that connects proteins, peptides, and Peptide-Spectrum Matches (PSMs). Key methodological aspects include:

  • Graph Neural Networks (GNNs): A tailored GNN architecture, inspired by GraphSAGE, is used to learn representations from the heterogeneous graph structure, effectively capturing complex relationships between proteins, peptides, and PSMs.
  • Semi-Supervised Learning: To address the lack of labeled data, GraphPI is primarily trained on large, unlabeled public protein datasets. Pseudo-labels are generated by an existing protein inference algorithm (Epifany) and then iteratively refined.
  • Self-Training: The model undergoes multiple rounds of self-training, where it refines its own predictions (pseudo-labels) based on confidence scores, leading to improved accuracy.
  • Hard Negative Decoy Information: Decoy proteins (artificially generated and known to be absent in biological samples) are explicitly used as negative labels to further improve the model's ability to distinguish true positives from false positives.
  • Universal Applicability: Unlike many existing methods, GraphPI's training on normalized features allows for dataset-independent fine-tuning, enhancing generalization and reducing overfitting.

Datasets

The study utilizes several public datasets for training and evaluation:

  • Training Datasets: Public protein datasets downloaded from ProteomeXchange. These include human data from various PXD identifiers (e.g., PXD004789, PXD005388, PXD006640).
  • Test Datasets:
    • iPRG2016 (A, B, AB)
    • UPS2
    • 18Mix
    • Yeast
    • Hela-3T3
    • Non-human datasets (e.g., from E. coli, D. melanogaster, M. musculus, R. norvegicus, A. thaliana)

Key Insights and Ideas

  • Graph Representation is Powerful: Framing protein inference as a graph problem, where proteins, peptides, and PSMs are interconnected nodes, allows for a more holistic understanding of their relationships, moving beyond isolated entities.
  • Semi-Supervised Learning + Self-Training = Robustness: Combining these techniques effectively circumvents the need for large, manually labeled datasets, a major hurdle in proteomics. The iterative refinement of labels is key to improving performance.
  • Decoy Proteins as Negative Examples are Crucial: Explicitly using decoy proteins as negative labels significantly improves GraphPI's performance, highlighting their importance in training robust models.
  • Universal Applicability is Achievable: The normalization of features allows GraphPI to generalize across different datasets without extensive re-training, a significant advantage for efficiency and scalability.

Key Results

  • State-of-the-Art Performance: GraphPI demonstrates competitive and often superior performance across various benchmark datasets, particularly in low False Discovery Rate (FDR) ranges. It ranks among the top performers on most datasets and achieves the best performance on the Yeast dataset.
  • Significant Speedup: GraphPI offers a substantial computational efficiency advantage, with inference times significantly lower than Bayesian methods like Epifany and Fido. For example, on the Yeast dataset, GraphPI takes 88 seconds, while Epifany takes over 14 minutes.
  • Linear Scaling: The GNN architecture ensures that inference time scales linearly with dataset size, making it suitable for large-scale proteomic analyses.
  • Robustness to Data Variations: The model shows consistent performance across diverse datasets, including those with high prevalence of shared peptides, and is relatively robust to the choice between isoform and non-isoform databases.

Limitations and Future Work

  • Limitations:
    • While GraphPI performs well, it can underperform in datasets with a very high prevalence of shared peptides among proteins, as seen in iPRG2016 A and B, where it falls behind Epifany. This is attributed to the training gap where decoy proteins typically don't share peptides with target proteins, limiting the model's exposure to differentiating such cases.
  • The accuracy of FDR estimation is noted to be less conservative than Epifany but more conservative than other methods.
  • Future Work:
    • Incorporating additional features and information, such as protein-protein interactions or post-translational modifications, could further enhance protein inference performance.
  • Exploring alternative settings for pretraining, such as using non-human or non-isoform databases, shows promising results and warrants further investigation.

Summary updated

Abstract

The integration of deep learning approaches in biomedical research has been transformative, enabling breakthroughs in various applications. Despite these strides, its application in protein inference is impeded by the scarcity of extensively labeled data sets, a challenge compounded by the high costs and complexities of accurate protein annotation. In this study, we introduce GraphPI, a novel framework that treats protein inference as a node classification problem. We treat proteins as interconnected nodes within a protein-peptide-PSM graph, utilizing a graph neural network-based architecture to elucidate their interrelations. To address label scarcity, we train the model on a set of unlabeled public protein data sets with pseudolabels derived from an existing protein inference algorithm, enhanced by self-training to iteratively refine labels based on confidence scores. Contrary to prevalent methodologies necessitating data set-specific training, our research illustrates that GraphPI, due to the well-normalized nature of Percolator features, exhibits universal applicability without data set-specific fine-tuning, a feature that not only mitigates the risk of overfitting but also enhances computational efficiency. Our empirical experiments reveal notable performance on various test data sets and deliver significantly reduced computation times compared to common protein inference algorithms.
BibTeX
@article{ma2024graphpi,
  author = {Zheng Ma and Jiazhen Chen and Lei Xin and Ali Ghodsi},
  title = {{GraphPI: Efficient Protein Inference with Graph Neural Networks}},
  journal = {Journal of Proteome Research},
  year = {2024},
  doi = {10.1021/acs.jproteome.3c00845},
}
Figure