Class Incremental Learning With Task-Selection

Eun Sung Kim, Jung Uk Kim, Sangmin Lee, Sang-Keun Moon, Yong Man RoICIP 2020 · OpenReview

Abstract

Despite the success of the deep neural networks (DNNs), in case of incremental learning, DNNs are known to suffer from catastrophic forgetting problems which are the phenomenon of entirely forgetting previously learned task information upon learning current task information. To alleviate this problem, we propose a novel knowledge distillation-based class incremental learning method with a task-selective autoencoder (TsAE). By learning the TsAE to reconstruct the feature map of each task, the proposed method effectively memorizes not only the classes of the current task but also the classes of previously learned tasks. Since the proposed TsAE has a simple but powerful architecture, it can be easily generalized to other knowledge distillation-based class incremental learning methods. Our experimental results on various datasets, including iCIFAR-100 and iILSVRC-small, demonstrated that the proposed method achieves higher classification accuracy and less forgetting compared to the stateof-the-art methods.
BibTeX
@inproceedings{kim2020class,
  author = {Eun Sung Kim and Jung Uk Kim and Sangmin Lee and Sang-Keun Moon and Yong Man Ro},
  title = {{Class Incremental Learning With Task-Selection}},
  booktitle = {ICIP},
  year = {2020},
  url = {https://openreview.net/forum?id=vpM-lSpU57},
}

Loading related content...

Figure