Non-linearity of Metabolic Pathways Critically Influences the Choice of Machine Learning Model

Ophélie Lo-Thong-Viramoutou, Philippe Charton, Xavier F. Cadet, Brigitte Grondin-Perez, Emma Saavedra, Cédric Damour, Frédéric Cadet

TL;DR

This paper investigates how the inherent non-linearity of metabolic pathways impacts the performance of different machine learning (ML) models. The authors demonstrate that non-linear ML models consistently outperform linear models for predicting pathway fluxes, providing a decision-making framework for selecting appropriate modeling approaches based on pathway characteristics.

What Problem Does This Paper Address?

Modeling metabolic pathways is crucial for understanding biological systems, designing drugs, and optimizing industrial processes. While mechanistic models and ML have been used, there's a lack of clarity on how the non-linear nature of metabolic pathways influences the choice of ML model. Specifically, it's unclear whether linear or non-linear ML methods are more effective for predicting pathway fluxes and how to select the right model. This paper aims to bridge this gap by systematically comparing various linear and non-linear ML models across different metabolic pathways.

Methods

The study employs a data-driven approach, utilizing both experimental and augmented datasets. For pathways with limited experimental data, a "gray-box" modeling approach was used. This involves creating hybrid models that combine mechanistic components (kinetic equations) with adjustable parameters to generate larger, synthetic datasets. Five linear and eight non-linear ML models were then trained and evaluated on these datasets. Model performance was assessed using Root Mean Squared Error (RMSE) and R-squared (R²) metrics, with k-fold cross-validation used for robust evaluation.

Datasets

The study used three distinct metabolic pathways:

  • Dataset 1: The lower part of the Entamoeba histolytica glycolysis pathway. Data was augmented using a gray-box model to create a dataset of 2,000 enzyme balances. A larger dataset of 68,950 enzyme balances was also generated.
  • Dataset 2: The peroxide detoxification pathway of Trypanosoma cruzi. Data was augmented using a gray-box model to create a dataset of 1,671 enzyme balances.
  • Dataset 3: The industrial-scale penicillin fermentation process of Penicillium chrysogenum. This dataset consisted solely of experimental data from bioreactor parameters.

Key Insights and Ideas

  • Non-linearity is King: The degree of non-linearity in a metabolic pathway is a critical factor in determining the success of ML models. Highly non-linear pathways benefit significantly from non-linear ML approaches.
  • Non-linear Models Dominate: Across all tested pathways, non-linear ML models, particularly Random Forests (QRF and Rborist), Cubist, and XGBoost Linear, consistently outperformed linear models in predicting pathway fluxes and product concentrations.
  • A Decision-Making Framework: The study proposes a structured approach to selecting ML models for pathway modeling, considering dataset quality, size, number of variables, and the pathway's inherent non-linearity.
  • Gray-Box Models for Data Scarcity: Hybrid "gray-box" models are effective for augmenting limited experimental data, enabling the application of ML techniques even when large datasets are unavailable.

Key Results

  • Performance Gap: Non-linear models achieved significantly better predictions. For instance, in Dataset 1, QRF achieved an RMSE of 0.021 nmol·min⁻¹ and R² of 1, while a Bayesian GLM (linear model) had an RMSE of 1.379 nmol·min⁻¹ and R² of 0.823.
  • Top Performers: Random Forests (QRF and Rborist), Cubist, and XGBoost Linear were consistently among the top-performing models across all datasets.
  • Dataset Impact: While non-linear models generally performed well, the size and nature of the dataset influenced performance. Larger datasets generally led to better predictions, but the degree of pathway non-linearity was a more dominant factor.
  • Linearity Matters for Linear Models: For Dataset 3, which exhibited a more linear nature, linear models showed improved performance compared to their performance on the more non-linear datasets, though still generally inferior to non-linear models.

Limitations and Future Work

  • Interpretability: While non-linear models show superior performance, their "black-box" nature can be a limitation. Future work could focus on developing more interpretable non-linear models or employing post-hoc interpretability techniques.
  • Variable Selection: The study used a single combination of input variables. Future research could explore the impact of different variable selection strategies on model performance.
  • Data Augmentation: While gray-box models were effective, the study acknowledges that predicted data, even from good models, is not a perfect substitute for experimental data. Future work could focus on testing models with purely experimental data when sufficient quantities are available.
  • Genome-Scale Models: The authors suggest extending this ML approach to genome-scale metabolic networks, which are rich in literature data, and integrating multi-omics data.
  • Extreme Data: Testing models on "extreme" or unexpected data points could further validate their robustness.

Summary updated

Abstract

The use of machine learning (ML) in life sciences has gained wide interest over the past years, as it speeds up the development of high performing models. Important modeling tools in biology have proven their worth for pathway design, such as mechanistic models and metabolic networks, as they allow better understanding of mechanisms involved in the functioning of organisms. However, little has been done on the use of ML to model metabolic pathways, and the degree of non-linearity associated with them is not clear. Here, we report the construction of different metabolic pathways with several linear and non-linear ML models. Different types of data are used; they lead to the prediction of important biological data, such as pathway flux and final product concentration. A comparison reveals that the data features impact model performance and highlight the effectiveness of non-linear models (e.g., QRF: RMSE = 0.021 nmol·min−1 and R2 = 1 vs. Bayesian GLM: RMSE = 1.379 nmol·min−1 R2 = 0.823). It turns out that the greater the degree of non-linearity of the pathway, the better suited a non-linear model will be. Therefore, a decision-making support for pathway modeling is established. These findings generally support the hypothesis that non-linear aspects predominate within the metabolic pathways. This must be taken into account when devising possible applications of these pathways for the identification of biomarkers of diseases (e.g., infections, cancer, neurodegenerative disease...
BibTeX
@article{lothongviramoutou2022non,
  author = {Ophélie Lo-Thong-Viramoutou and Philippe Charton and Xavier F. Cadet and Brigitte Grondin-Perez and Emma Saavedra and Cédric Damour and Frédéric Cadet},
  title = {{Non-linearity of Metabolic Pathways Critically Influences the Choice of Machine Learning Model}},
  journal = {Frontiers Artif. Intell},
  year = {2022},
  doi = {10.3389/frai.2022.744755},
}

Loading related content...

Figure