Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replay
원문 초록
Deep neural networks have demonstrated susceptibility to adversarial attacks. Adversarial defense techniques often focus on one-shot setting to maintain robustness against attack. However, new attacks can emerge in sequences in real-world deployment scenarios. As a result, it is crucial for a defense model to constantly adapt to new attacks, but the adaptation process can lead to catastrophic forgetting of previously defended against attacks. In this paper, we discuss for the first time the concept of continual adversarial defense under a sequence of attacks, and propose a lifelong defense baseline called Anisotropic \& Isotropic Replay (AIR), which offers three advantages: (1) Isotropic replay ensures model consistency in the neighborhood distribution of new data, indirectly aligning the output preference between old and new tasks. (2) Anisotropic replay enables the model to learn a compromise data manifold with fresh mixed semantics for further replay constraints and potential future attacks. (3) A straightforward regularizer mitigates the 'plasticity-stability' trade-off by aligning model output between new and old tasks. Experiment results demonstrate that AIR can approximate or even exceed the empirical performance upper bounds achieved by Joint Training.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach
Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Tracking
Accidental Misalignment: Fine-Tuning Language Models Induces Unexpected Vulnerability
A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection
GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models
Lightweight Defense Against Adversarial Attacks in Time Series Classification
토론
이 논문과 연결된 포럼 글이 아직 없습니다.