Bayesian Optimisation for Objective Functions with Varying Smoothness

A. V. Arun Kumar, Santu Rana, Cheng Li, Sunil Gupta, Alistair Shilton, Svetha Venkatesh

Abstract

Bayesian optimisation is a popular method in optimising complex, unknown and expensive objective functions. In complex design optimisation problems, the additional information about the smoothness, monotonicity or the modality of the unknown objective functions can be obtained either from the domain expertise or from the problem environment. Incorporating such additional information can potentially enhance the performance of the optimisation. We propose a methodology to incorporate the aforesaid extra information to have a better fitted surrogate model of the unknown objective function. Specifically, for Gaussian Process regression, we propose a covariance function to encompass varying smoothness across the input space through a parametric function whose parameters are tuned from the observations. Our experiments on both synthetic benchmark functions and real-world applications demonstrate that embodying such additional knowledge accelerates the convergence.
BibTeX
@inproceedings{kumar2019bayesian,
  author = {A. V. Arun Kumar and Santu Rana and Cheng Li and Sunil Gupta and Alistair Shilton and Svetha Venkatesh},
  title = {{Bayesian Optimisation for Objective Functions with Varying Smoothness}},
  booktitle = {Australasian Conference on Artificial Intelligence},
  year = {2019},
  doi = {10.1007/978-3-030-35288-2\_37},
}

Loading related content...

Figure