https://github.com/ist-daslab/gptq
공식 코드GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning
Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
Compacting, Picking and Growing for Unforgetting Continual Learning
Universal approximation and model compression for radial neural networks
Characterising Across-Stack Optimisations for Deep Convolutional Neural Networks
Differentially Private Knowledge Distillation via Synthetic Text Generation
CrossKD: Cross-Head Knowledge Distillation for Object Detection
Joint Channel and Weight Pruning for Model Acceleration on Moblie Devices
Visual Domain Adaptation for Monocular Depth Estimation on Resource-Constrained Hardware
Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks
COMCAT: Towards Efficient Compression and Customization of Attention-Based Vision Models
Tensorization of neural networks for improved privacy and interpretability
Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers
A Contrastive Knowledge Transfer Framework for Model Compression and Transfer Learning
Robustness and Transferability of Universal Attacks on Compressed Models
Shakeout: A New Approach to Regularized Deep Neural Network Training
Slicing Mutual Information Generalization Bounds for Neural Networks
Generalizing Teacher Networks for Effective Knowledge Distillation Across Student Architectures
Singular Value Scaling: Efficient Generative Model Compression via Pruned Weights Refinement
FLoCoRA: Federated learning compression with low-rank adaptation
Diffusion Models for Image Restoration and Enhancement -- A Comprehensive Survey
BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover's Distance
An Information Theory-inspired Strategy for Automatic Network Pruning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.