Treatment Effect Estimation to Guide Model Optimization in Continual Learning

Jonas Seng, Florian Peter Busch, Matej Zečević, Moritz Willig

Abstract

Continual Learning systems are faced with a potentially large numbers of tasks to be learned while the models employed have only limited capacity available, which makes it potentially impossible to learn all required tasks within a single model. In order to detect on when a model might break we propose to use treatment effect estimation techniques to estimate the effect of training a model on a new task w.r.t. some suitable performance measure.
BibTeX
@inproceedings{seng2023treatment,
  author = {Jonas Seng and Florian Peter Busch and Matej Zečević and Moritz Willig},
  title = {{Treatment Effect Estimation to Guide Model Optimization in Continual Learning}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2023},
  url = {https://openreview.net/forum?id=cbo9QaQv95},
}

Loading related content...

Figure