Lipschitz Bound Analysis of Neural Networks
원문 초록
Lipschitz Bound Estimation is an effective method of regularizing deep neural networks to make them robust against adversarial attacks. This is useful in a variety of applications ranging from reinforcement learning to autonomous systems. In this paper, we highlight the significant gap in obtaining a non-trivial Lipschitz bound certificate for Convolutional Neural Networks (CNNs) and empirically support it with extensive graphical analysis. We also show that unrolling Convolutional layers or Toeplitz matrices can be employed to convert Convolutional Neural Networks (CNNs) to a Fully Connected Network. Further, we propose a simple algorithm to show the existing 20x-50x gap in a particular data distribution between the actual lipschitz constant and the obtained tight bound. We also ran sets of thorough experiments on various network architectures and benchmark them on datasets like MNIST and CIFAR-10. All these proposals are supported by extensive testing, graphs, histograms and comparative analysis.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SelfDRSC++: Self-Supervised Learning for Dual Reversed Rolling Shutter Correction
Rolling Shutter Correction with Intermediate Distortion Flow Estimation
UniINR: Event-guided Unified Rolling Shutter Correction, Deblurring, and Interpolation
Stochastic Unrolled Federated Learning
Neural Image Re-Exposure
A Compound Gaussian Least Squares Algorithm and Unrolled Network for Linear Inverse Problems
토론
이 논문과 연결된 포럼 글이 아직 없습니다.