Accelerating and Compressing Deep Neural Networks for Massive MIMO CSI Feedback
원문 초록
The recent advances in machine learning and deep neural networks have made them attractive candidates for wireless communications functions such as channel estimation, decoding, and downlink channel state information (CSI) compression. However, most of these neural networks are large and inefficient making it a barrier for deployment in practical wireless systems that require low-latency and low memory footprints for individual network functions. To mitigate these limitations, we propose accelerated and compressed efficient neural networks for massive MIMO CSI feedback. Specifically, we have thoroughly investigated the adoption of network pruning, post-training dynamic range quantization, and weight clustering to optimize CSI feedback compression for massive MIMO systems. Furthermore, we have deployed the proposed model compression techniques on commodity hardware and demonstrated that in order to achieve inference gains, specialized libraries that accelerate computations for sparse neural networks are required. Our findings indicate that there is remarkable value in applying these model compression techniques and the proposed joint pruning and quantization approach reduced model size by 86.5% and inference time by 76.2% with minimal impact to model accuracy. These compression methods are crucial to pave the way for practical adoption and deployments of deep learning-based techniques in commercial wireless systems.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
FIMA-Q: Post-Training Quantization for Vision Transformers by Fisher Information Matrix Approximation
Structured Pruning and Quantization for Learned Image Compression
Efficient Speech Translation through Model Compression and Knowledge Distillation
DipSVD: Dual-importance Protected SVD for Efficient LLM Compression
RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Models
EAQuant: Enhancing Post-Training Quantization for MoE Models via Expert-Aware Optimization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.