Three-Level Prediction of Protein Function by Combining Profile-Sequence Search, Profile-Profile Search, and Domain Co-Occurrence Networks

Zheng Wang, Renzhi Cao, Jianlin ChengBMC Bioinformatics 2013 · OpenReview

TL;DR

This paper introduces a novel three-level approach to predict protein function, combining profile-sequence search, profile-profile search, and domain co-occurrence networks. This integrated method significantly improves prediction recall, especially for proteins with distant or no known homology, addressing a critical need in the era of massive genomic data.

What Problem Does This Paper Address?

The rapid generation of vast amounts of genomic and proteomic data has outpaced our ability to experimentally determine the function of every protein. Computational methods are crucial for annotating these sequences, but current approaches often struggle, particularly when a target protein shares little or no sequence similarity with proteins of known function. This "homology gap" limits the practical application of protein function prediction in fields like drug design and disease diagnosis. The authors aim to bridge this gap by developing a more robust and comprehensive prediction system that can handle varying degrees of homology, from obvious to none.

Methods

The core of this work is a three-level prediction strategy designed to leverage different types of information:

  • Level 1: Profile-Sequence Search (PSI-BLAST): This is a standard approach that uses PSI-BLAST to search a target protein sequence against a database of known proteins (Swiss-Prot). It's effective for identifying proteins with clear homology.
  • Level 2: Profile-Profile Search (HHSearch): This level employs HHSearch, a more sensitive tool for detecting remote homology by comparing protein profile hidden Markov models (HMMs) against a domain database (Pfam). This helps capture relationships that PSI-BLAST might miss.
  • Level 3: Domain Co-Occurrence Networks (DCN): This novel component addresses cases with no detectable homology. It analyzes the co-occurrence of protein domains within a species' genome. If a target protein contains domains found in this network, their neighboring domains' known functions are used to infer the target's function. This method can also handle multi-domain proteins by aggregating predictions from individual domains.

The authors developed three distinct predictors (Predictor-1, Predictor-2, Predictor-3) that combine the outputs of these levels using different weighting and integration strategies.

Datasets

The primary dataset used for evaluation was the set of protein targets from the 2011 Critical Assessment of Function Annotation (CAFA) challenge. This dataset comprised 48,298 protein targets, with 436 later used for evaluation after their functions were confirmed in the Swiss-Prot database. The methods also utilized public databases such as Swiss-Prot for homology searches and Pfam for domain identification. The DCN component relied on pre-constructed species-specific DCNs, including one for Homo sapiens.

Key Insights and Ideas

  • Complementary Strengths: The paper strongly emphasizes that combining different prediction methods (homology-based and network-based) is crucial for comprehensive function prediction. Each method has unique strengths that compensate for the weaknesses of others.
  • Bridging the Homology Gap: The DCN approach is a significant contribution, enabling function prediction even when no homology can be detected through sequence or profile searches. This is vital for annotating novel protein families.
  • Handling Multi-Domain Proteins: The DCN method naturally handles proteins with multiple domains by analyzing the co-occurrence of these domains, offering a more nuanced prediction than single-domain approaches.
  • Profile-Profile vs. Profile-Sequence: The results suggest that profile-profile alignment (HHSearch) is more sensitive than standard profile-sequence alignment (PSI-BLAST) for detecting remote homologies, leading to increased recall.
  • Trade-off between Precision and Recall: The study highlights the inherent trade-off. Methods that aim for higher recall (like the authors' integrated approach) may sacrifice some precision, while methods focusing on high precision (like the "Prior" baseline) often have lower recall.

Key Results

  • Improved Recall: The authors' integrated three-level predictors consistently achieved significantly higher recall compared to baseline methods (Prior, BLAST, GOtcha), with Predictor-1 reaching a recall of ~0.55 in top-n predictions and ~0.68 in sliding threshold evaluations.
  • Competitive Precision: While prioritizing recall, the predictors maintained reasonable precision. In overlapping recall ranges, the authors' methods often showed higher precision than baseline methods.
  • Break-even Point: Predictor-1 achieved the highest break-even value (where precision equals recall) at 0.306, indicating a good balance between precision and recall.
  • DCN's Contribution: The DCN component was shown to extend recall significantly, particularly for proteins where homology searches failed, demonstrating its value for ab initio prediction.
  • Semantic Similarity: The predictors also performed well in terms of semantic similarity of predicted Gene Ontology (GO) terms to true GO terms, outperforming baseline methods.

Limitations and Future Work

  • Precision vs. Recall Trade-off: The authors acknowledge that their methods, while improving recall, may have lower precision in some scenarios compared to methods that prioritize precision.
  • Computational Cost: While not explicitly detailed as a limitation, the multi-level approach involving multiple search tools and network construction likely incurs higher computational costs than simpler methods.
  • Future Work: The paper implicitly suggests future work could involve further optimizing the integration strategies of the three levels, exploring more sophisticated DCN construction, and potentially incorporating other data sources to further enhance prediction accuracy and coverage. The success of the DCN in handling multi-domain proteins also points towards further development in this area.

Summary updated

Abstract

Predicting protein function from sequence is useful for biochemical experiment design, mutagenesis analysis, protein engineering, protein design, biological pathway analysis, drug design, disease diagnosis, and genome annotation as a vast number of protein sequences with unknown function are routinely being generated by DNA, RNA and protein sequencing in the genomic era. However, despite significant progresses in the last several years, the accuracy of protein function prediction still needs to be improved in order to be used effectively in practice, particularly when little or no homology exists between a target protein and proteins with annotated function. Here, we developed a method that integrated profile-sequence alignment, profile-profile alignment, and Domain Co-Occurrence Networks (DCN) to predict protein function at different levels of complexity, ranging from obvious homology, to remote homology, to no homology. We tested the method blindingly in the 2011 Critical Assessment of Function Annotation (CAFA). Our experiments demonstrated that our three-level prediction method effectively increased the recall of function prediction while maintaining a reasonable precision. Particularly, our method can predict function terms defined by the Gene Ontology more accurately than three standard baseline methods in most situations, handle multi-domain proteins naturally, and make ab initio function prediction when no homology exists. These results show that our approach can combine complementary strengths of most widely used BLAST-based function prediction methods, rarely used in function prediction but more sensitive profile-profile comparison-based homology detection methods, and non-homology-based domain co-occurrence networks, to effectively extend the power of function prediction from high homology, to low homology, to no homology (ab initio cases).
BibTeX
@article{wang2013three,
  author = {Zheng Wang and Renzhi Cao and Jianlin Cheng},
  title = {{Three-Level Prediction of Protein Function by Combining Profile-Sequence Search, Profile-Profile Search, and Domain Co-Occurrence Networks}},
  journal = {BMC Bioinformatics},
  year = {2013},
  url = {https://openreview.net/forum?id=j3x8gIoF7Y},
}
Figure