Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models

Michael U. Gutmann, Jukka Corander

TL;DR

This paper introduces Bayesian Optimization for Likelihood-Free Inference (BOLFI), a novel approach to efficiently infer parameters of complex statistical models where the likelihood function is intractable. By combining probabilistic modeling of model discrepancies with Bayesian optimization, BOLFI significantly reduces the number of computationally expensive simulations required, accelerating inference by orders of magnitude.

What Problem Does This Paper Address?

Many real-world phenomena, particularly in fields like ecology, epidemiology, and physics, are modeled using "simulator-based" or "generative" models. These models define a process for generating data based on a set of parameters, but crucially, they don't provide an explicit mathematical formula for the probability of observing specific data given those parameters (the likelihood function). This intractability makes traditional statistical inference methods, which rely heavily on the likelihood, impossible.

Existing "likelihood-free" inference methods (like Approximate Bayesian Computation or ABC) try to circumvent this by comparing simulated data to observed data and finding parameter values that minimize the discrepancy. However, these methods are notoriously computationally expensive. They often require simulating vast amounts of data and lack guidance on which parameter values are most informative to explore, leading to inefficient searches. This paper tackles the computational bottleneck, aiming to make inference for these complex, realistic models feasible.

Methods

The core innovation is the integration of Bayesian Optimization (BO) into the likelihood-free inference pipeline. Instead of blindly simulating data across the parameter space, BOLFI uses BO to intelligently explore it. Here's a breakdown:

  • Probabilistic Modeling of Discrepancy: The authors model the discrepancy between simulated and observed data as a function of the model parameters. This function, which is itself unknown, is modeled using a Gaussian Process (GP). GPs provide a probabilistic framework, giving not just a prediction of the discrepancy but also a measure of uncertainty.
  • Bayesian Optimization for Efficient Exploration: BO uses the GP model to guide the search for optimal parameters. It employs an acquisition function (specifically, a lower confidence bound) that balances exploration (sampling in regions of high uncertainty) and exploitation (sampling in regions predicted to have low discrepancy). This allows the algorithm to efficiently focus on parameter regions that are most likely to yield good fits to the data.
  • Model-Based Likelihood Approximation: The learned GP model of the discrepancy is then used to construct an approximate likelihood function. This avoids the need for further simulations once the GP is trained, making the inference step itself computationally cheap.
  • Iterative Refinement: The process is iterative: BO selects a new parameter value to simulate, the discrepancy is computed, the GP model is updated with this new information, and the acquisition function is re-evaluated to select the next point. This active learning approach dramatically reduces the total number of simulations needed.

Datasets

The paper evaluates its method on three examples:

  1. Normal Distribution: An artificial example to illustrate core concepts.
  2. Ricker Model: A model from ecology used to simulate population dynamics. Data was generated using parameters from Wood (2010).
  3. Bacterial Infections in Day Care Centers: A model from epidemiology used to infer transmission dynamics. Data was generated using parameters from Numminen et al. (2013).

No new datasets were introduced; the focus was on applying the method to existing, challenging model structures.

Key Insights and Ideas

  • Discrepancy Modeling is Key: Instead of directly modeling the intractable likelihood, modeling the discrepancy between simulated and observed data proves to be a more tractable and effective approach for guiding inference.
  • Bayesian Optimization as an Intelligent Search: BO is not just an optimization tool; it's a principled way to learn about an unknown function (the discrepancy) by intelligently selecting where to query it. This is crucial when queries (simulations) are expensive.
  • Smoothness Assumption Pays Off: By modeling the discrepancy with a Gaussian Process, the method implicitly assumes smoothness in the relevant parameter regions. This assumption allows for efficient interpolation and extrapolation, reducing the need for exhaustive sampling.
  • Computational Savings are Massive: The most striking insight is the dramatic reduction in simulation requirements. This is the primary contribution and makes complex models accessible.

Key Results

The paper demonstrates substantial computational savings across its examples:

  • Ricker Model: BOLFI achieved results comparable to MCMC methods but required approximately 600 times fewer simulations.
  • Bacterial Infections Model: For approximating likelihood curves, BOLFI required 50 simulations per curve, whereas a standard sample-average approach required 15,000 simulations, yielding a 300-fold reduction.
  • The method successfully inferred parameters for complex models with unobserved latent variables and strong nonlinearities.
  • The approach provided stable and accurate posterior distributions, often matching or improving upon existing methods.

Limitations and Future Work

  • Scalability in High Dimensions: While the method shows promise, the authors acknowledge that high-dimensional parameter spaces remain challenging. Discovering low-discrepancy regions becomes harder as dimensionality increases.
  • Tail Probabilities: The current approach focuses on modal areas (where discrepancy is small). Accurately approximating tail probabilities (rare events) might require modifications.
  • Acquisition Function Choice: While the lower confidence bound is used, other acquisition functions could be explored.
  • Gaussian Process Model Assumptions: The use of a stationary Gaussian process with uncorrelated noise might not always be appropriate. Heteroscedasticity (variance depending on parameter values) could require more advanced GP models.
  • Future Work: The authors suggest exploring extensions for high-dimensional inference, developing more tailored acquisition rules for likelihood-free inference, and investigating methods for improving tail probability accuracy, potentially through recursive updates.

Summary updated

Abstract

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We assume that only a finite number of parameters are of interest and allow the generative process to be very general; it may be a noisy nonlinear dynamical system with an unrestricted number of hidden variables. This weak assumption is useful for devising realistic models but it renders statistical inference very difficult. The main challenge is the intractability of the likelihood function. Several likelihood-free inference methods have been proposed which share the basic idea of identifying the parameters by finding values for which the discrepancy between simulated and observed data is small. A major obstacle to using these methods is their computational cost. The cost is largely due to the need to repeatedly simulate data sets and the lack of knowledge about how the parameters affect the discrepancy. We propose a strategy which combines probabilistic modeling of the discrepancy with optimization to facilitate likelihood-free inference. The strategy is implemented using Bayesian optimization and is shown to accelerate the inference through a reduction in the number of required simulations by several orders of magnitude.
BibTeX
@article{gutmann2016bayesian,
  author = {Michael U. Gutmann and Jukka Corander},
  title = {{Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models}},
  journal = {J. Mach. Learn. Res.},
  year = {2016},
  url = {https://openreview.net/forum?id=gNwHNecSKw},
}
Figure