A Memory-Efficient Learning Framework for SymbolLevel Precoding with Quantized NN Weights
원문 초록
This paper proposes a memory-efficient deep neural network (DNN) framework-based symbol level precoding (SLP). We focus on a DNN with realistic finite precision weights and adopt an unsupervised deep learning (DL) based SLP model (SLP-DNet). We apply a stochastic quantization (SQ) technique to obtain its corresponding quantized version called SLP-SQDNet. The proposed scheme offers a scalable performance vs memory tradeoff, by quantizing a scale-able percentage of the DNN weights, and we explore binary and ternary quantizations. Our results show that while SLP-DNet provides near-optimal performance, its quantized versions through SQ yield 3.46x and 2.64x model compression for binary-based and ternary-based SLP-SQDNets, respectively. We also find that our proposals offer 20x and 10x computational complexity reductions compared to SLP optimization-based and SLP-DNet, respectively.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
FIMA-Q: Post-Training Quantization for Vision Transformers by Fisher Information Matrix Approximation
Structured Pruning and Quantization for Learned Image Compression
Efficient Speech Translation through Model Compression and Knowledge Distillation
DipSVD: Dual-importance Protected SVD for Efficient LLM Compression
RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Models
EAQuant: Enhancing Post-Training Quantization for MoE Models via Expert-Aware Optimization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.