https://github.com/ambroggi/pruning-project-for-deep-neural-networks
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning
MicroExpNet: An Extremely Small and Fast Model For Expression Recognition From Face Images
MicroExpNet: An Extremely Small and Fast Model For Expression Recognition From Face Images
Efficient model compression with Random Operation Access Specific Tile (ROAST) hashing
GASL: Guided Attention for Sparsity Learning in Deep Neural Networks
Revisiting Random Channel Pruning for Neural Network Compression
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Basic Binary Convolution Unit for Binarized Image Restoration Network
Weightless: Lossy Weight Encoding For Deep Neural Network Compression
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
GASL: Guided Attention for Sparsity Learning in Deep Neural Networks
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
TX-Ray: Quantifying and Explaining Model-Knowledge Transfer in (Un-)Supervised NLP
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
MicroExpNet: An Extremely Small and Fast Model For Expression Recognition From Face Images
The continuous categorical: a novel simplex-valued exponential family
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
To prune, or not to prune: exploring the efficacy of pruning for model compression
Going Beyond Classification Accuracy Metrics in Model Compression
DE-RRD: A Knowledge Distillation Framework for Recommender System
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.