On the uncertainty principle of neural networks
원문 초록
In this study, we explore the inherent trade-off between accuracy and robustness in neural networks, drawing an analogy to the uncertainty principle in quantum mechanics. We propose that neural networks are subject to an uncertainty relation, which manifests as a fundamental limitation in their ability to simultaneously achieve high accuracy and robustness against adversarial attacks. Through mathematical proofs and empirical evidence, we demonstrate that this trade-off is a natural consequence of the sharp boundaries formed between different class concepts during training. Our findings reveal that the complementarity principle, a cornerstone of quantum physics, applies to neural networks, imposing fundamental limits on their capabilities in simultaneous learning of conjugate features. Meanwhile, our work suggests that achieving human-level intelligence through a single network architecture or massive datasets alone may be inherently limited. Our work provides new insights into the theoretical foundations of neural network vulnerability and opens up avenues for designing more robust neural network architectures.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
StepProof: Step-by-step verification of natural language mathematical proofs
A Theoretical Analysis of Compositional Generalization in Neural Networks: A Necessary and Sufficient Condition
Hierarchical Attention Generates Better Proofs
Distance-Adaptive Quaternion Knowledge Graph Embedding with Bidirectional Rotation
Learning Rules Explaining Interactive Theorem Proving Tactic Prediction
ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattings
토론
이 논문과 연결된 포럼 글이 아직 없습니다.