DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning
원문 초록
Continual learning aims to equip models with the ability to retain previously learned knowledge like a human. Recent work incorporating Parameter-Efficient Fine-Tuning has revitalized the field by introducing lightweight extension modules. However, existing methods usually overlook the issue of information leakage caused by the fact that the experiment data have been used in pre-trained models. Once these duplicate data are removed in the pre-training phase, their performance can be severely affected. In this paper, we propose a new LoRA-based rehearsal-free method named DESIRE. Our method avoids imposing additional constraints during training to mitigate catastrophic forgetting, thereby maximizing the learning of new classes. To integrate knowledge from old and new tasks, we propose two efficient post-processing modules. On the one hand, we retain only two sets of LoRA parameters for merging and propose dynamic representation consolidation to calibrate the merged feature representation. On the other hand, we propose decision boundary refinement to address classifier bias when training solely on new class data. Extensive experiments demonstrate that our method achieves state-of-the-art performance on multiple datasets and strikes an effective balance between stability and plasticity. Our code will be publicly available.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learning
Gated Integration of Low-Rank Adaptation for Continual Learning of Language Models
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
Train with Perturbation, Infer after Merging: A Two-Stage Framework for Continual Learning
Parameter Efficient Continual Learning with Dynamic Low-Rank Adaptation
Parameter-Efficient Continual Fine-Tuning: A Survey
토론
이 논문과 연결된 포럼 글이 아직 없습니다.