Gene-Metabolite Association Prediction with Interactive Knowledge Transfer Enhanced Graph for Metabolite Production

Heng Ji, Kexuan Xin, Qingyun Wang, Junyu Chen, Pengfei Yu, Huimin Zhao, Heng Ji 0001

TL;DR

This paper introduces a novel task, Gene-Metabolite Association Prediction, to automate the identification of genes crucial for enhancing metabolite production. They propose an Interactive Knowledge Transfer (IKT4Meta) framework that leverages pre-trained language models and graph neural networks to integrate knowledge from multiple microbial metabolic graphs, significantly improving prediction accuracy.

What Problem Does This Paper Address?

Metabolic engineering aims to engineer microorganisms into efficient "cell factories" for producing valuable compounds. A key challenge is identifying the right genes to manipulate for increased metabolite production. Traditional methods, relying on manual literature mining or complex genome-scale metabolic models (GEMs), are time-consuming and labor-intensive. Furthermore, GEMs are often incomplete, containing "knowledge gaps" and missing annotations, especially for less-studied organisms. This paper addresses these limitations by proposing a new task and a framework to automate gene target identification through predicting associations between genes and metabolites within metabolic graphs.

Methods

The core of the proposed solution is the Interactive Knowledge Transfer on Metabolism Graph (IKT4Meta) framework, which operates in two main stages: graph enrichment and association prediction.

  1. Graph Enrichment:
    • Multi-modal Encoder: This component integrates diverse information for genes and metabolites. It uses pre-trained language models (PLMs) to process textual descriptions (surface form and detailed descriptions) and external knowledge like SMILE strings for metabolites and FASTA sequences for genes. This creates rich initial vertex embeddings.
  2. Graph Alignment: A Graph Convolutional Network (GCN) with a Highway gate and Graph Attention Network (GAT) is used to aggregate neighboring information and learn vertex representations. The goal is to identify "inter-graph links" – equivalent or highly similar genes/metabolites across different microbial metabolic graphs. A margin-based ranking loss is used to minimize distances between known inter-graph links.
  3. "Dangling" Elimination: This strategy mitigates the negative impact of "danglings" (vertices with limited connections or ambiguous annotations) during graph alignment. It dynamically identifies and reduces the influence of such vertices, improving the robustness of inter-graph link discovery.
  4. Interactive Knowledge Transfer: This is the key innovation. It uses the discovered inter-graph links as bridges to transfer knowledge between metabolic graphs. This involves:
  5. Inter-graph link transfer: Inferring new inter-graph links based on high similarity and mutual nearest neighbor relationships between vertices.
  6. Intra-graph link transfer: Generating new gene-metabolite association triples (intra-graph links) by leveraging the inter-graph links. This effectively enriches the metabolic graph structure.
  7. Association Prediction:
    • Once the metabolic graphs are enriched with knowledge from other organisms, a triple-level function is used to measure the plausibility of gene-metabolite associations. A margin-based objective function is employed to learn these associations, predicting missing triples.

Datasets

The paper introduces a new benchmark dataset constructed from the metabolic graphs of two microorganisms:

  • Saccharomyces cerevisiae (SC): A well-studied organism.
  • Issatchenkia orientalis (IO): A less-studied organism.

The dataset includes gene and metabolite information, intra-graph links (gene-metabolite associations), and inter-graph links (shared genes/metabolites). The data is split into training, testing, and validation sets for the association prediction task.

Key Insights and Ideas

  • Framing Gene Target Identification as Association Prediction: The paper reframes the complex task of identifying target genes for metabolite production into a more manageable gene-metabolite association prediction problem, simplifying information extraction.
  • The Power of Cross-Organism Knowledge Transfer: Metabolic engineering benefits immensely from integrating knowledge across different organisms, especially when dealing with under-studied species like Issatchenkia orientalis. The IKT4Meta framework effectively bridges these knowledge gaps.
  • Complementarity of Text and Structure: Combining textual information (from PLMs) with graph structure (from GCNs/GATs) is crucial. Textual embeddings provide essential prior knowledge for identifying inter-graph links, especially when structural information is sparse or ambiguous.
  • "Dangling" Vertices are a Major Hurdle: The presence of "danglings" significantly complicates graph alignment and inter-graph link discovery. The proposed elimination strategy is vital for improving the accuracy of these links.
  • Iterative Enrichment is Key: The interactive nature of knowledge transfer, where newly inferred links further refine the graph structure, leads to a virtuous cycle of improvement.

Key Results

  • The IKT4Meta framework outperforms baseline link prediction models (TransE, RotatE, DisMult) by up to 12.3% in gene-metabolite association prediction accuracy across both SC and IO.
  • The framework shows significant improvements, particularly for the sparser Issatchenkia orientalis graph, demonstrating its effectiveness in leveraging knowledge from better-studied organisms.
  • Ablation studies confirm the importance of each component: multi-modal embeddings, knowledge transfer, and dangling elimination all contribute to the overall performance gains. Removing multi-modal embeddings leads to a 4-6% F1 score drop, while removing dangling elimination results in a ~2% drop.

Limitations and Future Work

  • Limitations:
    • The paper acknowledges that while the "dangling" elimination strategy helps, it doesn't entirely remove the impact of these vertices.
  • The performance improvement from the dangling elimination strategy is less pronounced when multi-modal embeddings are replaced by random initialization, suggesting that strong initial embeddings can partially compensate for the lack of explicit dangling handling.
  • Future Work:
    • The authors suggest incorporating reaction information into the constructed metabolic graphs for future work, which could further enhance the predictive capabilities.
  • The framework's ability to handle heterogeneity and knowledge gaps makes it promising for future complex inference tasks such as enzyme prediction and compound overproduction.

Summary updated

Abstract

In the rapidly evolving field of metabolic engineering, the quest for efficient and precise gene target identification for metabolite production enhancement presents significant challenges. Traditional approaches, whether knowledge-based or model-based, are notably time-consuming and labor-intensive, due to the vast scale of research literature and the approximation nature of genome-scale metabolic model (GEM) simulations. Therefore, we propose a new task, Gene-Metabolite Association Prediction based on metabolic graphs, to automate the process of candidate gene discovery for a given pair of metabolite and candidate-associated genes, as well as presenting the first benchmark containing 2474 metabolites and 1947 genes of two commonly used microorganisms Saccharomyces cerevisiae (SC) and Issatchenkia orientalis (IO). This task is challenging due to the incompleteness of the metabolic graphs and the heterogeneity among distinct metabolisms. To overcome these limitations, we propose an Interactive Knowledge Transfer mechanism based on Metabolism Graph (IKT4Meta), which improves the association prediction accuracy by integrating the knowledge from different metabolism graphs. First, to build a bridge between two graphs for knowledge transfer, we utilize Pretrained Language Models (PLMs) with external knowledge of genes and metabolites to help generate inter-graph links, significantly alleviating the impact of heterogeneity. Second, we propagate intra-graph links from different metabolic graphs using inter-graph links as anchors. Finally, we conduct the gene-metabolite association prediction based on the enriched metabolism graphs, which integrate the knowledge from multiple microorganisms. Experiments on both types of organisms demonstrate that our proposed methodology outperforms baselines by up to 12.3% across various link prediction frameworks.
BibTeX
@inproceedings{ji2024gene,
  author = {Heng Ji and Kexuan Xin and Qingyun Wang and Junyu Chen and Pengfei Yu and Huimin Zhao and Heng Ji},
  title = {{Gene-Metabolite Association Prediction with Interactive Knowledge Transfer Enhanced Graph for Metabolite Production}},
  booktitle = {BIBM},
  year = {2024},
  doi = {10.1109/bibm62325.2024.10822779},
}
Figure