PowerPruning: Selecting Weights and Activations for Power-Efficient Neural Network Acceleration
원문 초록
Deep neural networks (DNNs) have been successfully applied in various fields. A major challenge of deploying DNNs, especially on edge devices, is power consumption, due to the large number of multiply-and-accumulate (MAC) operations. To address this challenge, we propose PowerPruning, a novel method to reduce power consumption in digital neural network accelerators by selecting weights that lead to less power consumption in MAC operations. In addition, the timing characteristics of the selected weights together with all activation transitions are evaluated. The weights and activations that lead to small delays are further selected. Consequently, the maximum delay of the sensitized circuit paths in the MAC units is reduced even without modifying MAC units, which thus allows a flexible scaling of supply voltage to reduce power consumption further. Together with retraining, the proposed method can reduce power consumption of DNNs on hardware by up to 78.3% with only a slight accuracy loss.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LightSNN: Lightweight Architecture Search for Sparse and Accurate Spiking Neural Networks
Automatic Joint Structured Pruning and Quantization for Efficient Neural Network Training and Compression
When do they StOP?: A First Step Towards Automatically Identifying Team Communication in the Operating Room
HALO: Hadamard-Assisted Lower-Precision Optimization for LLMs
Learn2Mix: Training Neural Networks Using Adaptive Data Integration
Efficient Neural Network Encoding for 3D Color Lookup Tables
토론
이 논문과 연결된 포럼 글이 아직 없습니다.