Lifelong Learning with Gaussian Processes

Christopher Clingerman, Eric EatonECML/PKDD 2017 · OpenReview

Abstract

Recent developments in lifelong machine learning have demonstrated that it is possible to learn multiple tasks consecutively, transferring knowledge between those tasks to accelerate learning and improve performance. However, these methods are limited to using linear parametric base learners, substantially restricting the predictive power of the resulting models. We present a lifelong learning algorithm that can support non-parametric models, focusing on Gaussian processes. To enable efficient online transfer between Gaussian process models, our approach assumes a factorized formulation of the covariance functions, and incrementally learns a shared sparse basis for the models’ parameterizations. We show that this lifelong learning approach is highly computationally efficient, and outperforms existing methods on a variety of data sets.
BibTeX
@inproceedings{clingerman2017lifelong,
  author = {Christopher Clingerman and Eric Eaton},
  title = {{Lifelong Learning with Gaussian Processes}},
  booktitle = {ECML/PKDD},
  year = {2017},
  url = {https://openreview.net/forum?id=oLKTafJVQh},
}

Loading related content...

Figure