Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data
원문 초록
The Industrial Internet of Things (IIoT) integrates interconnected sensors and devices to support industrial applications, but its dynamic environments pose challenges related to data drift. Considering the limited resources and the need to effectively adapt models to new data distributions, this paper introduces a Continual Learning (CL) approach, i.e., Distillation-based Self-Guidance (DSG), to address challenges presented by industrial streaming data via a novel generative replay mechanism. DSG utilizes knowledge distillation to transfer knowledge from the previous diffusion-based generator to the updated one, improving both the stability of the generator and the quality of reproduced data, thereby enhancing the mitigation of catastrophic forgetting. Experimental results on CWRU, DSA, and WISDM datasets demonstrate the effectiveness of DSG. DSG outperforms the state-of-the-art baseline in accuracy, demonstrating improvements ranging from 2.9% to 5.0% on key datasets, showcasing its potential for practical industrial applications.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learning
Knowledge Grafting of Large Language Models
Continual Self-Supervised Learning with Masked Autoencoders in Remote Sensing
Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging
Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer
Ranking-aware Continual Learning for LiDAR Place Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.