https://github.com/mit-han-lab/llm-awq
공식 코드AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).
Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
QuantumNAT: Quantum Noise-Aware Training with Noise Injection, Quantization and Normalization
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
QuantumNAT: Quantum Noise-Aware Training with Noise Injection, Quantization and Normalization
Vector Quantized Time Series Generation with a Bidirectional Prior Model
Training Deep Neural Networks with Joint Quantization and Pruning of Weights and Activations
Training Deep Neural Networks with Joint Quantization and Pruning of Weights and Activations
"Lossless" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach
LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit
MQBench: Towards Reproducible and Deployable Model Quantization Benchmark
QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models
TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models
A Survey on Inference Optimization Techniques for Mixture of Experts Models
Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devices
SLiM: One-shot Quantization and Sparsity with Low-rank Approximation for LLM Weight Compression
Does quantization affect models' performance on long-context tasks?
QLESS: A Quantized Approach for Data Valuation and Selection in Large Language Model Fine-Tuning
UVeQFed: Universal Vector Quantization for Federated Learning
Orthonormal Product Quantization Network for Scalable Face Image Retrieval
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.