Defending Against Adversarial Attacks by Suppressing the Largest Eigenvalue of Fisher Information Matrix
원문 초록
We propose a scheme for defending against adversarial attacks by suppressing the largest eigenvalue of the Fisher information matrix (FIM). Our starting point is one explanation on the rationale of adversarial examples. Based on the idea of the difference between a benign sample and its adversarial example is measured by the Euclidean norm, while the difference between their classification probability densities at the last (softmax) layer of the network could be measured by the Kullback-Leibler (KL) divergence, the explanation shows that the output difference is a quadratic form of the input difference. If the eigenvalue of this quadratic form (a.k.a. FIM) is large, the output difference becomes large even when the input difference is small, which explains the adversarial phenomenon. This makes the adversarial defense possible by controlling the eigenvalues of the FIM. Our solution is adding one term representing the trace of the FIM to the loss function of the original network, as the largest eigenvalue is bounded by the trace. Our defensive scheme is verified by experiments using a variety of common attacking methods on typical deep neural networks, e.g. LeNet, VGG and ResNet, with datasets MNIST, CIFAR-10, and German Traffic Sign Recognition Benchmark (GTSRB). Our new network, after adopting the novel loss function and retraining, has an effective and robust defensive capability, as it decreases the fooling ratio of the generated adversarial examples, and remains the classification accuracy of the original network.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CausalDiff: Causality-Inspired Disentanglement via Diffusion Model for Adversarial Defense
Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach
Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Tracking
Accidental Misalignment: Fine-Tuning Language Models Induces Unexpected Vulnerability
A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection
GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.