A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learning

Martin Mundt, Yongwon Hong, Iuliia Pliushch, Visvanathan Ramesh

This paper, titled "A Wholistic View of Continual Learning with Deep Neural Networks," offers a critical wake-up call to the machine learning community. While deep learning has made massive strides, the authors argue that the sub-field of Continual Learning (CL)—the study of models that learn from a stream of data over time—has become dangerously narrow, focusing almost exclusively on preventing "catastrophic forgetting" in artificial, "closed-world" scenarios.

TL;DR

The authors propose a "wholistic" framework that bridges Continual Learning with Active Learning and Open Set Recognition. By using Extreme Value Theory (EVT) to map the boundaries of known data, they create a unified system that can robustly identify unknown instances, query the most informative new data, and preserve existing knowledge more effectively than current specialized methods.

What Problem Does This Paper Address?

In a typical machine learning setup, we assume a "closed world": the model is trained on a fixed dataset and will only ever see similar data in the real world. Continual Learning attempts to break this by allowing models to learn new tasks sequentially. However, most CL research focuses solely on the "stability-plasticity dilemma"—how to learn new things without forgetting the old.

The authors argue this ignores two critical real-world realities:

  1. The Open World: Real data streams contain "unknown unknowns"—noise, corruptions, or entirely new categories that a model shouldn't just blindly try to classify.
  2. Data Selection: In the real world, we often have to choose what to learn next. This is the domain of Active Learning, yet it is rarely integrated into CL benchmarks.

Current models are notoriously overconfident; they will assign a high-confidence label to a random noise image or a category they've never seen, leading to "meaningless predictions" during deployment.

Methods

The authors propose a unified framework based on Meta-Recognition using Extreme Value Theory (EVT).

Instead of relying on simple heuristics like softmax entropy (which they show is unreliable for detecting outliers), they use a Classifying Variational Autoencoder (VAE). The key innovation is fitting a Weibull distribution to the distances of latent representations from their class means. This allows the model to define a "trustworthy" boundary for known data.

Figure 1: The five main pillars of lifelong machine learning according to Chen and Liu (2017). Note that the first three pillars were originally proposed and the last two added recently in a second edition redefinition to emphasize new frontiers.

This single mathematical tool serves three purposes:

  • Open Set Recognition: If a new data point falls far outside the Weibull-defined boundaries, it is rejected or flagged as "unknown."
  • Active Learning: The model queries new data that sits in the "heavy tail" of the distribution—data that is statistically novel but not so far out that it's likely to be uninformative noise.
  • Continual Learning: To prevent forgetting, the model selects a "core set" of exemplars by inversely sampling the Weibull distribution, ensuring the stored memory accurately represents the entire density of previously learned tasks.

The authors provide a comprehensive taxonomy of how these fields intersect in Figure 4: Visual taxonomy of neural network based methods for continual learning, active learning and open set recognition.

Figure 4: Visual taxonomy of neural network based methods for continual learning, active learning and open set recognition.

Datasets

The study utilizes several standard benchmarks to demonstrate the "forgotten lessons" of the field:

  • MNIST & Fashion-MNIST: Used for initial proof-of-concept and showing the failures of overconfident uncertainty measures.
  • CIFAR-10 & CIFAR-100: Used for complex image classification and testing task-ordering curricula.
  • AudioMNIST: Used to show the framework's applicability to non-image data.
  • Corrupted CIFAR-10: A version of the dataset with 15 types of digital and environmental corruptions (blur, noise, etc.) to test robustness.

Key Insights and Ideas

  • Uncertainty is not enough: A major "forgotten lesson" is that predictive uncertainty (like Monte Carlo Dropout) is not a reliable proxy for the open set. Models can be highly certain and completely wrong when facing "unknown unknowns."
  • Task Order Matters: The authors debunk the common claim that the order of tasks in CL is negligible. They show that a curriculum—specifically learning the most "outlying" or dissimilar tasks first—can improve final accuracy by as much as 10% on CIFAR-100.
  • The Synergy of OSR and AL: Open Set Recognition provides the natural interface for Active Learning. By identifying what is "unknown," the model can actively build its own learning curriculum rather than relying on a human-in-the-loop to provide a fixed sequence of tasks.

Key Results

  • Robustness: In the presence of 7.5% corrupted data, standard active learning and core-set methods (like k-means or herding) failed, often querying the corruptions as "novel" data. The EVT-based approach remained stable, effectively filtering out uninformative outliers.
  • Exemplar Selection: The proposed latent EVT sampling consistently outperformed random sampling and greedy k-center approaches in approximating the true data distribution for memory replay.
  • Active Learning: The EVT query strategy significantly outperformed baselines like reconstruction loss and MCD-entropy, reaching higher accuracies with fewer labeled examples.

Limitations and Future Work

  • VAE Scaling: The authors acknowledge that while VAEs are excellent for defining latent boundaries, they can struggle to scale to extremely high-resolution, complex datasets compared to GANs or Diffusion models.
  • Uni-modal Assumption: The EVT approach currently assumes that classes form uni-modal clusters in latent space. While this is encouraged by the training objective, it isn't mathematically guaranteed in all scenarios.
  • Future Directions: The authors suggest moving toward more realistic benchmarks like CLEAR or Wild-Time, which feature natural distribution shifts over years, rather than the artificial "split-dataset" tasks common today.

Summary updated

Abstract

Current deep learning methods are regarded as favorable if they empirically perform well on dedicated test sets. This mentality is seamlessly reflected in the resurfacing area of continual learning, where consecutively arriving data is investigated. The core challenge is framed as protecting previously acquired representations from being catastrophically forgotten. However, comparison of individual methods is nevertheless performed in isolation from the real world by monitoring accumulated benchmark test set performance. The closed world assumption remains predominant, i.e. models are evaluated on data that is guaranteed to originate from the same distribution as used for training. This poses a massive challenge as neural networks are well known to provide overconfident false predictions on unknown and corrupted instances. In this work we critically survey the literature and argue that notable lessons from open set recognition, identifying unknown examples outside of the observed set, and the adjacent field of active learning, querying data to maximize the expected performance gain, are frequently overlooked in the deep learning era. Hence, we propose a consolidated view to bridge continual learning, active learning and open set recognition in deep neural networks. Finally, the established synergies are supported empirically, showing joint improvement in alleviating catastrophic forgetting, querying data, selecting task orders, while exhibiting robust open world application.
BibTeX
@inproceedings{mundt2020wholistic,
  author = {Martin Mundt and Yongwon Hong and Iuliia Pliushch and Visvanathan Ramesh},
  title = {{A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learning}},
  booktitle = {Neural Networks},
  year = {2020},
  doi = {10.1016/j.neunet.2023.01.014},
}
Figure