Abstract
Continual Learning (CL) is a pivotal challenge in machine learning, aiming to enable models to learn new tasks sequentially without suffering from "catastrophic forgetting." This survey explores the evolution of CL methodologies, categorizing them into traditional "train-from-scratch" approaches and modern strategies leveraging Pre-trained Models (PTMs). By balancing the "Stability-Plasticity" dilemma, researchers have moved from memory replay and regularization toward lightweight fine-tuning and prompt-based adaptation. Current evidence suggests that PTM-based methods offer superior performance and robustness, defining the current state-of-the-art in the field.
Introduction: The Stability-Plasticity Dilemma
Standard machine learning models typically operate under the assumption of static data distributions. When these models encounter a stream of non-stationary tasks, they often experience Catastrophic Forgetting (CF)—a phenomenon where new information overwrites the weights necessary for previous tasks.
The fundamental challenge in CL is the Stability-Plasticity Dilemma. A model must maintain enough plasticity to acquire new knowledge while ensuring sufficient stability to preserve existing memories. This balance is critical for applications in dynamic environments, such as autonomous driving, robotics, and evolving medical diagnostic systems.
Methodological Evolution
The landscape of CL research can be broadly divided into two eras: traditional continual training (dominant from 2017 to 2024) and the recent shift toward Pre-trained Model-based methods (emerging strongly since 2022).
1. Traditional Continual Training
Traditional methods focus on training models from scratch or from simple initializations. They generally fall into three categories:
- Memory Replay: These methods store a subset of previous data (exemplars) or use generative models (e.g., GANs) to synthesize old data, which is then interleaved with new task data during training to "rehearse" old knowledge.
- Regularization: These approaches add constraints to the loss function to protect important parameters. Weight regularization (e.g., EWC) penalizes changes to weights critical for past tasks, while functional regularization uses techniques like knowledge distillation to keep the model's output behavior consistent.
- Dynamic Architectures: Instead of keeping the model fixed, these methods adapt the network structure. This might involve adding new neurons for new tasks or using sub-network masking to isolate task-specific pathways.
2. PTM-based Continual Learning
The advent of large-scale Pre-trained Models (PTMs) like ViT and BERT has revolutionized CL. PTMs provide a robust foundation of general features, allowing the model to focus on task adaptation rather than learning representations from scratch.
- Fine-tuning based: Rather than full-parameter updates, these methods use lightweight modules like Adapters or LoRA. By keeping the backbone frozen, the model preserves its general knowledge while adapting to specific task nuances.
- Prompt-based: This paradigm learns a "Prompt Pool" or specific task prompts (e.g., L2P, DualPrompt). The model learns to select or generate the correct prompt to guide the frozen PTM's features toward the current task, requiring no storage of raw data and minimal parameter overhead.
Performance and Benchmarking
The survey highlights a significant performance gap between traditional and PTM-based methods across standard benchmarks like Split CIFAR-100 and ImageNet-R.
| Method Category | Benchmark | Accuracy | Forgetting Rate |
|---|---|---|---|
| Traditional (iCaRL) | CIFAR-100 | ~66% | High |
| PTM-based (EASE) | CIFAR-100 | 88.11% | Low (<6%) |
| Traditional (EWC) | ImageNet-R | ~35% | High |
| PTM-based (CPrompt) | ImageNet-R | 75.30% | Low |
PTM-based methods consistently demonstrate higher accuracy and significantly lower forgetting rates (often under 6%, compared to 30-50% for some traditional regularization methods).
Future Directions and Challenges
Despite recent progress, several frontiers remain:
- Efficiency: PTMs are computationally expensive. Future research must focus on making these methods viable for resource-constrained edge devices.
- Unsupervised Learning: Moving away from labeled task streams toward self-supervised continual learning is essential for real-world scalability.
- Task Diversity: Current methods struggle when sequential tasks have large domain gaps (e.g., natural images followed by medical scans).
- LLM Integration: Leveraging the reasoning capabilities of Large Language Models (LLMs) to enhance visual CL is a promising new avenue.
Conclusion
The field of Continual Learning has undergone a paradigm shift. While traditional methods laid the groundwork for managing the stability-plasticity trade-off, PTM-based approaches—particularly those utilizing prompting—currently offer the most effective solution for mitigating catastrophic forgetting in complex, large-scale scenarios.
Summary updated