CFTS-GAN: Continual Few-Shot Teacher Student for Generative Adversarial Networks
원문 초록
Few-shot and continual learning face two well-known challenges in GANs: overfitting and catastrophic forgetting. Learning new tasks results in catastrophic forgetting in deep learning models. In the case of a few-shot setting, the model learns from a very limited number of samples (e.g. 10 samples), which can lead to overfitting and mode collapse. So, this paper proposes a Continual Few-shot Teacher-Student technique for the generative adversarial network (CFTS-GAN) that considers both challenges together. Our CFTS-GAN uses an adapter module as a student to learn a new task without affecting the previous knowledge. To make the student model efficient in learning new tasks, the knowledge from a teacher model is distilled to the student. In addition, the Cross-Domain Correspondence (CDC) loss is used by both teacher and student to promote diversity and to avoid mode collapse. Moreover, an effective strategy of freezing the discriminator is also utilized for enhancing performance. Qualitative and quantitative results demonstrate more diverse image synthesis and produce qualitative samples comparatively good to very stronger state-of-the-art models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Adversarial attacks to image classification systems using evolutionary algorithms
Synthesizing Reality: Leveraging the Generative AI-Powered Platform Midjourney for Construction Worker Detection
AdaptaGen: Domain-Specific Image Generation through Hierarchical Semantic Optimization Framework
Advancements and Challenges in Continual Reinforcement Learning: A Comprehensive Review
HybridQ: Hybrid Classical-Quantum Generative Adversarial Network for Skin Disease Image Generation
Beyond Blur: A Fluid Perspective on Generative Diffusion Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.