Improving Plasticity in Online Continual Learning via Collaborative Learning

Maorong Wang, Nicolas Michel, Ling Xiao, Toshihiko Yamasaki

Introduction

Online Continual Learning (CL) presents a significant challenge for deep learning models: the requirement to learn from a non-stationary data stream where each sample is observed only once. Historically, research in this field has focused primarily on stability—the prevention of "catastrophic forgetting" of previously acquired knowledge. However, this paper argues that focusing solely on stability is insufficient. The authors identify plasticity—the model's inherent capacity to effectively acquire new information—as a critical but often neglected bottleneck in online CL performance.

The Plasticity Challenge

A fundamental performance gap exists between offline learning (where data is seen multiple times) and online learning. Even when utilizing memory replay buffers to store past samples, online models struggle to match the learning accuracy of their offline counterparts. To quantify this, the authors derive a relationship for performance:

$$Average Accuracy \approx Plasticity \times (1 - Forgetting)$$

This formula demonstrates that high final accuracy is unattainable without addressing the "plasticity gap." As illustrated in the comparative analysis below, online models exhibit significantly lower learning accuracy compared to offline baselines, regardless of the number of memory iterations.

The plasticity gap between offline and online CL settings, highlighting the disparity in learning accuracy.

Methodology: Collaborative Continual Learning with Distillation Chain (CCL-DC)

To bridge this gap, the authors propose Collaborative Continual Learning with Distillation Chain (CCL-DC). This framework introduces two primary innovations:

1. Collaborative Continual Learning (CCL)

Instead of optimizing a single model, CCL employs two peer models ($\theta^1$ and $ heta^2$) that learn from the data stream simultaneously. These models act as peer teachers, distilling knowledge to one another. This parallel optimization provides the learners with greater flexibility and prevents the optimization process from getting stuck in poor local minima early in the stream.

2. Distillation Chain (DC)

The authors discovered that overconfidence in online CL leads to poor generalization. To combat this, they implemented a "hard-to-easy" optimization strategy:

  • Augmentation Chain: Input images undergo a sequence of increasingly intense data augmentations, creating a spectrum of "hard" to "easy" samples.
  • Distillation Chain: The models perform distillation from less confident predictions (generated from hard samples) to more confident predictions (generated from easier samples). This acts as a form of learned entropy regularization, suppressing overconfidence and encouraging the model to learn more robust, generalizable features.
Overview of the CCL-DC framework, illustrating the parallel peer models and the progression from Augmentation Chain to Distillation Chain.

Experimental Results

The CCL-DC framework was evaluated on standard benchmarks including CIFAR-10, CIFAR-100, Tiny-ImageNet, and ImageNet-100. The method was integrated into six state-of-the-art CL baselines, including Experience Replay (ER) and Dark Experience Replay (DER++).

Key findings include:

  • Significant Performance Gains: On Tiny-ImageNet with a memory buffer of 2000, CCL-DC improved the baseline ER accuracy from 10.82% to 16.56%—a 53% relative improvement.
  • Enhanced Plasticity: Across all datasets, the "Learning Accuracy" metric saw dramatic increases, often by 10-20 percentage points, confirming that the method successfully improves the model's ability to learn new tasks.
  • Faster Convergence: Loss curve analysis indicates that CCL-DC allows models to descend deeper into the loss landscape more rapidly than standard methods.
  • Robust Feature Learning: GradCAM visualizations revealed that CCL-DC helps models focus on relevant objects rather than background "shortcuts," leading to more reliable classification.

Conclusion

By shifting the focus from mere stability to active plasticity improvement, CCL-DC provides a powerful new direction for Online Continual Learning. The combination of peer-teaching and entropy-regulating distillation chains effectively bridges the plasticity gap, allowing online models to approach the performance levels of offline learning systems.

Summary updated

Abstract

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing online CL research regards catastrophic forgetting (i.e., model stability) as almost the only challenge. In this paper, we argue that the model's capability to acquire new knowledge (i.e., model plasticity) is another challenge in online CL. While replay-based strategies have been shown to be effective in alleviating catastrophic forgetting, there is a notable gap in research attention toward improving model plasticity. To this end, we propose Collaborative Continual Learning (CCL), a collaborative learning based strategy to improve the model's capability in acquiring new concepts. Additionally, we introduce Distillation Chain (DC), a collaborative learning scheme to boost the training of the models. We adapt CCL-DC to existing representative online CL works. Extensive experiments demonstrate that even if the learners are well-trained with state-of-the-art online CL methods, our strategy can still improve model plasticity dramatically, and thereby improve the overall performance by a large margin. The source code of our work is available at https://github.com/maorong-wang/CCL-DC.
BibTeX
@inproceedings{wang2024improving,
  author = {Maorong Wang and Nicolas Michel and Ling Xiao and Toshihiko Yamasaki},
  title = {{Improving Plasticity in Online Continual Learning via Collaborative Learning}},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2024},
  doi = {10.1109/cvpr52733.2024.02214},
}
Figure