Neuron Pruning for Compressing Deep Networks using Maxout Architectures
원문 초록
This paper presents an efficient and robust approach for reducing the size of deep neural networks by pruning entire neurons. It exploits maxout units for combining neurons into more complex convex functions and it makes use of a local relevance measurement that ranks neurons according to their activation on the training set for pruning them. Additionally, a parameter reduction comparison between neuron and weight pruning is shown. It will be empirically shown that the proposed neuron pruning reduces the number of parameters dramatically. The evaluation is performed on two tasks, the MNIST handwritten digit recognition and the LFW face verification, using a LeNet-5 and a VGG16 network architecture. The network size is reduced by up to $74\%$ and $61\%$, respectively, without affecting the network's performance. The main advantage of neuron pruning is its direct influence on the size of the network architecture. Furthermore, it will be shown that neuron pruning can be combined with subsequent weight pruning, reducing the size of the LeNet-5 and VGG16 up to $92\%$ and $80\%$ respectively.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Contraction Mapping of Feature Norms for Classifier Learning on the Data with Different Quality
Compact and Efficient Neural Networks for Image Recognition Based on Learned 2D Separable Transform
A Rapid Test for Accuracy and Bias of Face Recognition Technology
Sample Correlation for Fingerprinting Deep Face Recognition
Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verification
DAAL: Density-Aware Adaptive Line Margin Loss for Multi-Modal Deep Metric Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.