Extracting Protein-Protein Interaction based on Discriminative Training of the Hidden Vector State Model

Deyu Zhou, Yulan HeBioNLP 2008

Abstract

Automating the extraction of protein-protein interactions (PPI) from scientific literature is a critical task in bioinformatics. This paper proposes a discriminative training framework for the Hidden Vector State (HVS) model to improve semantic parsing performance. Unlike traditional Maximum Likelihood Estimation (MLE), which focuses solely on the correct parse, the discriminative approach explicitly minimizes a parse error measure to better distinguish between correct and incorrect semantic structures. Experimental results on the GENIA corpus demonstrate a 2.5% relative improvement in F-measure, driven primarily by a significant gain in recall.

Introduction

The rapid growth of biological research has led to a vast amount of knowledge being "trapped" in unstructured text. Manually extracting protein-protein interactions is no longer feasible at scale. Semantic parsers, particularly the Hidden Vector State (HVS) model, have emerged as effective tools for this task. The HVS model extends the Hidden Markov Model (HMM) by using a stack-based structure to capture hierarchical sentence constraints without the complexity of full context-free grammars.

However, standard HVS models are typically trained using Maximum Likelihood Estimation (MLE). A key limitation of MLE is its inability to account for the proximity of incorrect parses; it maximizes the likelihood of the correct parse but does not explicitly penalize "near-miss" errors. In the complex domain of biological text, this often leads to misclassifications.

Methodology

The authors introduce a discriminative training objective to enhance the robustness of the HVS model.

HVS Model Structure

The HVS model represents each state as a vector, effectively a stack of semantic tags. This allows the model to handle long-distance dependencies and nested structures common in scientific language (e.g., "Protein A inhibits the complex formed by Protein B and C").

Discriminative Optimization

The proposed method shifts the focus from likelihood maximization to error minimization. A parse error measure is defined to calculate the distance between the ground-truth parse and a set of competing hypotheses. This measure is then transformed into a smooth loss function using a sigmoid operator.

Parameter Estimation

The model parameters are adjusted using the Generalized Probabilistic Descent (GPD) algorithm. This iterative process simultaneously increases the probability of the correct parse while decreasing the probability of the most competitive incorrect parses. A tunable parameter ($\eta$) allows the training to focus on the top-ranked incorrect hypothesis or an average of multiple competitors.

Experimental Setup

The approach was evaluated using the GENIA corpus, a standard benchmark consisting of 2,000 MEDLINE abstracts. The researchers filtered the corpus for sentences containing at least two protein names and one interaction keyword (e.g., "binds," "inhibits"). From the resulting pool of 3,533 relevant sentences, a dataset of 2,500 sentences was sampled for training and testing.

Results

The discriminative training approach showed consistent improvements over the MLE baseline across all evaluation metrics.

Performance comparison between MLE and Discriminative training on the GENIA corpus.

As shown in the table above, the most significant improvement was observed in Recall, which increased from 61.78% to 64.59%. This suggests that the discriminative model is more effective at identifying interactions that the baseline model fails to capture. The overall F-measure improved from 61.47% to 63.01%, representing a meaningful advancement in PPI extraction accuracy.

Conclusion and Future Work

This study demonstrates that discriminative training significantly enhances the performance of HVS models for protein-protein interaction extraction. By explicitly modeling the competition between correct and incorrect parses, the system becomes more robust to the complexities of biological literature.

While successful, the current study is limited by a relatively small dataset of 2,500 sentences. Future research should explore the scalability of this approach to larger datasets and its applicability to other specialized domains such as chemistry or clinical medicine. Additionally, integrating stack-based HVS logic with modern deep learning architectures could potentially yield further performance gains.

Summary updated

BibTeX
@inproceedings{zhou2008extracting,
  author = {Deyu Zhou and Yulan He},
  title = {{Extracting Protein-Protein Interaction based on Discriminative Training of the Hidden Vector State Model}},
  booktitle = {BioNLP},
  year = {2008},
}
Figure