Defensive Dual Masking for Robust Adversarial Defense
원문 초록
The field of textual adversarial defenses has gained considerable attention in recent years due to the increasing vulnerability of natural language processing (NLP) models to adversarial attacks, which exploit subtle perturbations in input text to deceive models. This paper introduces the Defensive Dual Masking (DDM) algorithm, a novel approach designed to enhance model robustness against such attacks. DDM utilizes a unique adversarial training strategy where [MASK] tokens are strategically inserted into training samples to prepare the model to handle adversarial perturbations more effectively. During inference, potentially adversarial tokens are dynamically replaced with [MASK] tokens to neutralize potential threats while preserving the core semantics of the input. The theoretical foundation of our approach is explored, demonstrating how the selective masking mechanism strengthens the model's ability to identify and mitigate adversarial manipulations. Our empirical evaluation across a diverse set of benchmark datasets and attack mechanisms consistently shows that DDM outperforms state-of-the-art defense techniques, improving model accuracy and robustness. Moreover, when applied to Large Language Models (LLMs), DDM also enhances their resilience to adversarial attacks, providing a scalable defense mechanism for large-scale NLP applications.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach
Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Tracking
Accidental Misalignment: Fine-Tuning Language Models Induces Unexpected Vulnerability
A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection
GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models
Lightweight Defense Against Adversarial Attacks in Time Series Classification
토론
이 논문과 연결된 포럼 글이 아직 없습니다.