Towards perturbation prediction of biological networks using deep learning

Diya Li, Jianxi GaoScientific 2019 · DOI

TL;DR

This paper tackles the challenge of predicting how perturbations spread through complex biological networks, a crucial task for understanding disease and developing treatments. They introduce a novel approach using Graph Convolutional Networks (GCNs) to learn "impact patterns" from network topology, significantly improving prediction accuracy over existing topology-only methods.

What Problem Does This Paper Address?

Understanding biological systems often involves mapping the intricate interactions between biochemical entities. While this mapping is becoming more comprehensive, accurately modeling the dynamics of these systems is hindered by the difficulty of measuring kinetic parameters. This has led to a reliance on topology-based models, which use the network structure to infer how a perturbation in one component might affect others. However, these pure topology-based models struggle with the scale and heterogeneity of real-world biological networks. The authors aim to bridge this gap by enhancing topology-based models with deep learning, specifically GCNs, to better capture the underlying perturbation patterns.

Methods

The core of the proposed method is the integration of Graph Convolutional Networks (GCNs) to learn an "enhancement factor" that improves upon existing topology-based models.

  1. DYNAMO Model: The paper builds upon the DYNAMO (DYNamics-Agnostic Network Models) framework, which uses network topology to predict perturbation patterns. DYNAMO offers several models, including a "distance model" that assumes perturbation strength decays with network distance from the source.
  2. Enhancement Factor Generation: To create the enhancement factor, the authors extract the Jacobian matrix from the system's differential equations. They then derive a "bio-impact matrix" by ranking the values within each column of the Jacobian. This matrix is then scaled (using a log transformation) and normalized to create the "scaled impact matrix," which serves as the enhancement factor ($E$).
  3. Graph Convolutional Networks (GCNs): GCNs are employed to learn these enhancement factors. The authors propose two GCN architectures:
  4. Full Graph Model: All influence networks are combined into a single, larger graph with an added center node.
  5. Sparse Graph Model: Each influence network is treated individually, and their feature matrices are concatenated. The adjacency matrix is a sparse block-diagonal matrix. These GCN models are trained to predict the enhancement factor for a given biological network.

  6. Final Prediction: The predicted enhancement factor ($E$) is then used to modify the predictions of the distance model, aiming to improve overall perturbation pattern prediction accuracy.

Datasets

The study utilizes the BioModels database, a repository of curated biological dynamic models. From this database, 333 BioModels were extracted and used for training and testing the proposed models. The authors note that they used the same dataset as previous DYNAMO studies for direct comparison.

Key Insights and Ideas

  • Topology is Not Enough: The paper strongly suggests that relying solely on network topology for perturbation prediction is insufficient for complex biological systems.
  • Learning Implicit Patterns: GCNs are powerful tools for learning hidden "impact patterns" that are not explicitly captured by simple topological measures. These learned patterns act as a crucial enhancement.
  • Sparse Model Advantage: The sparse graph model, which processes individual networks with a specific pooling matrix, outperforms the full graph model. This highlights the benefit of handling network heterogeneity more effectively.
  • Enhancement Factor Effectiveness: Using the learned enhancement factor derived from the Jacobian matrix significantly boosts the accuracy of existing topology-based models, particularly the distance model.
  • Robustness: The proposed GCN-based models demonstrate greater stability and robustness compared to DYNAMO models, especially in cases where overall prediction accuracy is low.

Key Results

The proposed GCN-based models achieve an average accuracy of 73% on perturbation pattern prediction across 87 biological networks. This represents a 7% improvement over the best topology-based model (DYNAMO's propagation model at 66%) and a 10% improvement over DYNAMO's distance model (63%). The sparse graph model achieved 73% accuracy, outperforming the full graph model (70%). The study also establishes upper bounds for prediction accuracy, indicating that achieving 100% accuracy in predicting the enhancement factor could lead to an 84% perturbation pattern prediction accuracy.

Limitations and Future Work

  • Limitations:
    • The paper acknowledges that the "scaled impact matrix prediction is more adaptable to train a generalized graph convolutional network." This implies that while the full bio-impact matrix might offer a higher theoretical upper bound, it's less practical for training.
  • The performance of the models is still dependent on the quality and completeness of the available biological network data.
  • Future Work:
    • The authors pose several open questions, including how to apply this method to predict perturbation patterns in other complex systems (e.g., food webs, social networks, financial networks).
  • They suggest exploring ways to further improve prediction accuracy.
  • Investigating how higher-order network characteristics (like communities and degree correlations) influence prediction accuracy is also proposed.
  • The generality and portability of the model are highlighted, suggesting its applicability to other dynamic networks with fewer constraints on individual network properties.

Summary updated

Abstract

The mapping of the physical interactions between biochemical entities enables quantitative analysis of dynamic biological living systems. While developing a precise dynamical model on biological entity interaction is still challenging due to the limitation of kinetic parameter detection of the underlying biological system. This challenge promotes the needs of topology-based models to predict biochemical perturbation patterns. Pure topology-based model, however, is limited on the scale and heterogeneity of biological networks. Here we propose a learning based model that adopts graph convolutional networks to learn the implicit perturbation pattern factors and thus enhance the perturbation pattern prediction on the basic topology model. Our experimental studies on 87 biological models show an average of 73% accuracy on perturbation pattern prediction and outperforms the best topology-based model by 7%, indicating that the graph-driven neural network model is robust and beneficial for accurate prediction of the perturbation spread modeling and giving an inspiration of the implementation of the deep neural networks on biological network modeling.
BibTeX
@inproceedings{li2019towards,
  author = {Diya Li and Jianxi Gao},
  title = {{Towards perturbation prediction of biological networks using deep learning}},
  booktitle = {Scientific},
  year = {2019},
  doi = {10.1038/s41598-019-48391-y},
}

Loading related content...

Figure