Bayesian inversion of a diffusion model with application to biology

Jean-Charles Croix, Nicolas Durrande, Mauricio A. ÁlvarezJournal of Mathematical Biology 2021 · DOI

TL;DR

This paper tackles the challenging problem of "reverse-engineering" biological systems by inferring unknown parameters (like diffusion and self-regulation rates) and a functional source term from noisy experimental data. They achieve this by applying a sophisticated Bayesian methodology for infinite-dimensional inverse problems, which provides a robust way to quantify uncertainty in these complex estimations.

What Problem Does This Paper Address?

In many scientific fields, especially biology, we have mathematical models describing phenomena, but the exact parameters governing these models are unknown. The goal is to infer these parameters and even unknown components of the model (like a "source term" representing the rate of production or decay) from observed data. This is known as "inverse modeling" or "reverse-engineering." When the models involve complex systems like partial differential equations (PDEs), this task becomes particularly difficult because the problem can be "ill-posed." This means that small errors in the data can lead to large errors in the estimated parameters, or that multiple parameter sets could explain the same data. The authors focus on a specific model: a linear parabolic PDE that describes protein transcription from mRNA, where they want to estimate diffusion rates, self-regulation rates, and a functional source term.

Methods

The core of this paper is the application of a recent Bayesian methodology for infinite-dimensional inverse problems. This approach offers several advantages:

  • Unified Approach: It simultaneously handles the ill-posedness of the problem (regularization) and quantifies the uncertainty in the parameter estimates.
  • Infinite-Dimensional Spaces: The methodology is developed directly in function spaces, postponing discretization until the very end. This makes the algorithms more robust to discretization choices.
  • Prior Specification: They define a prior probability distribution on the unknown parameters, incorporating existing knowledge or assumptions. For the functional source term, they use a re-parameterization to ensure positivity and model it using a continuous Gaussian process.
  • Posterior Distribution: Bayes' theorem is used to derive a posterior probability distribution for the parameters given the data. This distribution encapsulates all the information about the parameters after observing the data.
  • Maximum A Posteriori (MAP) Estimator: To summarize the posterior distribution, they compute the MAP estimate, which represents the most probable parameter values. This is achieved by minimizing a generalized Onsager-Machlup functional.
  • State-of-the-Art MCMC: For sampling from the posterior distribution, they employ a geometric Markov Chain Monte Carlo (MCMC) algorithm, specifically an infinite-dimensional manifold Modified Adjusted Langevin Algorithm (∞-mMALA). This algorithm is adapted to handle the non-Gaussian nature of their posterior.

Datasets

The authors use a dataset from a previous study by Becker et al. (2013). This dataset consists of 508 non-uniformly spread measurements of protein concentration over time and space, related to the developmental biology of Drosophila melanogaster. No new datasets are introduced.

Key Insights and Ideas

  • Bayesian Framework for Ill-Posed Problems: The paper demonstrates the power of the Bayesian approach in providing a principled and robust way to handle ill-posed inverse problems, offering both parameter estimates and reliable uncertainty quantification.
  • Modeling Biological Dynamics: The application to protein transcription highlights the relevance of these advanced statistical methods for understanding complex biological processes where parameters are often unknown and data is noisy.
  • Infinite-Dimensional MCMC: The successful application of an infinite-dimensional MCMC algorithm showcases the progress in computational statistics for tackling problems with infinitely many parameters (like functions).
  • Trade-offs in Parameter Identifiability: The results suggest a lack of identifiability between the diffusion and decay parameters, meaning that similar data could be explained by different combinations of these parameters. The Bayesian approach, however, quantifies this uncertainty rather than ignoring it.

Key Results

  • The paper successfully applies the Bayesian inverse problem methodology to infer the diffusion rate ($\lambda$), self-regulation rate ($D$), and a functional source term ($f$) for a protein transcription model.
  • They obtain a MAP estimate for the parameters, which aligns with previously observed biological events (e.g., two distinct peaks in protein concentration).
  • The MCMC sampling provides posterior distributions, allowing for uncertainty quantification. For example, the marginal posterior distributions for $\lambda$ and $D$ show some correlation, indicating limited identifiability.
  • The posterior point-wise variance of the source term and solution around data locations is generally low, suggesting good confidence in these estimates where data is available. However, before the first observations, the variance on the solution is higher, indicating expected uncertainty.

Limitations and Future Work

  • Hyper-parameter Estimation: The paper acknowledges that the estimation of prior hyper-parameters (like the noise variance $\sigma_\eta^2$) is challenging and not fully resolved. They propose an empirical approach for tuning $\sigma_\eta^2$, but note that this area requires further research.
  • Uniqueness of Posterior Modes: Due to the non-linear nature of the forward model, the uniqueness of posterior modes (MAP estimates) is unclear, and the authors observe the presence of local maximas.
  • Data Requirements: The authors suggest that more data, particularly with precise time/space repartition, would be beneficial to further refine the model and reduce uncertainty in certain regions.
  • Future Research: They explicitly state that further research is needed to address the estimation of prior hyper-parameters.

Summary updated

Abstract

A common task in experimental sciences is to fit mathematical models to real-world measurements to improve understanding of natural phenomenon (reverse-engineering or inverse modelling). When complex dynamical systems are considered, such as partial differential equations, this task may become challenging or ill-posed. In this work, a linear parabolic equation is considered as a model for protein transcription from MRNA. The objective is to estimate jointly the differential operator coefficients, namely the rates of diffusion and self-regulation, as well as a functional source. The recent Bayesian methodology for infinite dimensional inverse problems is applied, providing a unique posterior distribution on the parameter space continuous in the data. This posterior is then summarized using a Maximum a Posteriori estimator. Finally, the theoretical solution is illustrated using a state-of-the-art MCMC algorithm adapted to this non-Gaussian setting.
BibTeX
@article{croix2021bayesian,
  author = {Jean-Charles Croix and Nicolas Durrande and Mauricio A. Álvarez},
  title = {{Bayesian inversion of a diffusion model with application to biology}},
  journal = {Journal of Mathematical Biology},
  year = {2021},
  doi = {10.1007/s00285-021-01621-2},
}
Figure