Adversarial Training is a Form of Data-dependent Operator Norm Regularization
원문 초록
We establish a theoretical link between adversarial training and operator norm regularization for deep neural networks. Specifically, we prove that $\ell_p$-norm constrained projected gradient ascent based adversarial training with an $\ell_q$-norm loss on the logits of clean and perturbed inputs is equivalent to data-dependent (p, q) operator norm regularization. This fundamental connection confirms the long-standing argument that a network's sensitivity to adversarial examples is tied to its spectral properties and hints at novel ways to robustify and defend against adversarial attacks. We provide extensive empirical evidence on state-of-the-art network architectures to support our theoretical results.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Generative Latent Kernel Modeling for Blind Motion Deblurring
Differentially Private Relational Learning with Entity-level Privacy Guarantees
EtiCor++: Towards Understanding Etiquettical Bias in LLMs
Fragility in Average Treatment Effect on the Treated under Limited Covariate Support
Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learning
Assessing parameter identifiability of a hemodynamics PDE model using spectral surrogates and dimension reduction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.