https://github.com/lawrencerliu/nowag
공식 코드NoWag: A Unified Framework for Shape Preserving Compression of Large Language Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).
Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
NoWag: A Unified Framework for Shape Preserving Compression of Large Language Models
SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimation
Federated learning compression designed for lightweight communications
FLoCoRA: Federated learning compression with low-rank adaptation
L-GreCo: Layerwise-Adaptive Gradient Compression for Efficient and Accurate Deep Learning
DVD-Quant: Data-free Video Diffusion Transformers Quantization
Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation
Hierarchical Prior-based Super Resolution for Point Cloud Geometry Compression
TinySubNets: An efficient and low capacity continual learning strategy
INT-FP-QSim: Mixed Precision and Formats For Large Language Models and Vision Transformers
EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization
Picking Up Quantization Steps for Compressed Image Classification
Eliminating Quantization Errors in Classification-Based Sound Source Localization
Quaff: Quantized Parameter-Efficient Fine-Tuning under Outlier Spatial Stability Hypothesis
Semi-supervised 3D Object Detection with PatchTeacher and PillarMix
Reduce Information Loss in Transformers for Pluralistic Image Inpainting
Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregation
Equal Bits: Enforcing Equally Distributed Binary Network Weights
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
GLARE: Low Light Image Enhancement via Generative Latent Feature based Codebook Retrieval
Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression
Routing-Guided Learned Product Quantization for Graph-Based Approximate Nearest Neighbor Search
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.