Computational and Storage Efficient Quadratic Neurons for Deep Neural Networks
원문 초록
Deep neural networks (DNNs) have been widely deployed across diverse domains such as computer vision and natural language processing. However, the impressive accomplishments of DNNs have been realized alongside extensive computational demands, thereby impeding their applicability on resource-constrained devices. To address this challenge, many researchers have been focusing on basic neuron structures, the fundamental building blocks of neural networks, to alleviate the computational and storage cost. In this work, an efficient quadratic neuron architecture distinguished by its enhanced utilization of second-order computational information is introduced. By virtue of their better expressivity, DNNs employing the proposed quadratic neurons can attain similar accuracy with fewer neurons and computational cost. Experimental results have demonstrated that the proposed quadratic neuron structure exhibits superior computational and storage efficiency across various tasks when compared with both linear and non-linear neurons in prior work.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Perception-Oriented Latent Coding for High-Performance Compressed Domain Semantic Inference
Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks
Admissibility of Stein Shrinkage for Batch Normalization in the Presence of Adversarial Attacks
DecoupleNet: A Lightweight Backbone Network With Efficient Feature Decoupling for Remote Sensing Visual Tasks
A Robust Feature Downsampling Module for Remote Sensing Visual Tasks
Alleviating Textual Reliance in Medical Language-guided Segmentation via Prototype-driven Semantic Approximation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.