Semantic-oriented Visual Prompt Learning for Class Incremental Learning
Lists
Only you see this
Abstract
Class-incremental learning (CIL) enables models to continuously learn new classes while addressing catastrophic forgetting. With the introduction of pre-trained models, new tuning paradigms have emerged for CIL. This paper revisits parameter-efficient fine-tuning (PEFT) methods in the context of incremental learning. Prior studies reveal that PEFT methods’ extended parameters do not directly contribute to semantic perception, limiting performance with significant category and domain gaps. To address this, we propose semantic-oriented visual prompt learning (SVPL), which enhances semantic perception and improves task-specific knowledge extraction. SVPL assigns learnable prompts to each class, using a contrastive group alignment to align prompts to task-specific semantic spaces, thus preserving relationships between old and new knowledge. Additionally, hierarchical semantic delivery allows the semantic transformation of prompt groups from shallow to deep layers to facilitate efficient knowledge mining and enable effective learning of new knowledge. Extensive experimental results on five benchmarks demonstrate the superior performance of our methods.
BibTeX
@inproceedings{guo2025semantic,
author = {Shuai Guo and Yang Gu and Yuan Ma and Yingwei Zhang and Weining Weng and Jun Liu and Weiwei Dai and Yiqiang Chen},
title = {{Semantic-oriented Visual Prompt Learning for Class Incremental Learning}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2025},
url = {https://openreview.net/forum?id=SEywSjb39R},
}Loading related content...