Lifelong Learning for Deep Neural Networks with Bayesian Principles
Lists
Only you see this
Abstract
This chapter describes a general Bayesian framework for the lifelong learning of artificial neural networks that can handle catastrophic forgetting in a principled way. The framework can be applied to both discriminative and generative models as well as task-aware and task-agnostic settings. We introduce the variational continual learning algorithm, a realization of this framework that uses online variational inference with a small amount of memory or coreset for effective lifelong learning. We examine various practical considerations when using this algorithm and show that it performs competitively against other lifelong learning approaches on different benchmarks. We also discuss several improvements to the algorithm and outline some future research directions for Bayesian lifelong learning.
BibTeX
@inproceedings{nguyen2024lifelong,
author = {Cuong V. Nguyen and Siddharth Swaroop and Thang D Bui and Yingzhen Li and Richard E. Turner},
title = {{Lifelong Learning for Deep Neural Networks with Bayesian Principles}},
booktitle = {WORLD},
year = {2024},
doi = {10.1142/9789811286711\_0004},
}Loading related content...