Pruning Very Deep Neural Network Channels for Efficient Inference
원문 초록
In this paper, we introduce a new channel pruning method to accelerate very deep convolutional neural networks. Given a trained CNN model, we propose an iterative two-step algorithm to effectively prune each layer, by a LASSO regression based channel selection and least square reconstruction. We further generalize this algorithm to multi-layer and multi-branch cases. Our method reduces the accumulated error and enhances the compatibility with various architectures. Our pruned VGG-16 achieves the state-of-the-art results by 5x speed-up along with only 0.3% increase of error. More importantly, our method is able to accelerate modern networks like ResNet, Xception and suffers only 1.4%, 1.0% accuracy loss under 2x speed-up respectively, which is significant. Our code has been made publicly available.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SepPrune: Structured Pruning for Efficient Deep Speech Separation
Differentiable Channel Selection in Self-Attention For Person Re-Identification
SlimSeiz: Efficient Channel-Adaptive Seizure Prediction Using a Mamba-Enhanced Network
Learning Binary Color Filter Arrays with Trainable Hard Thresholding
Improving the Evaluation and Actionability of Explanation Methods for Multivariate Time Series Classification
Quantifying Spatial Domain Explanations in BCI using Earth Mover's Distance
토론
이 논문과 연결된 포럼 글이 아직 없습니다.