https://github.com/rucaibox/quantizedempirical
공식 코드Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).
Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact
Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models
Hierarchical Vector Quantized Transformer for Multi-class Unsupervised Anomaly Detection
QEBVerif: Quantization Error Bound Verification of Neural Networks
PLUM: Improving Inference Efficiency By Leveraging Repetition-Sparsity Trade-Off
MobileQuant: Mobile-friendly Quantization for On-device Language Models
When Attention Sink Emerges in Language Models: An Empirical View
SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction
Efficient Mixed Precision Quantization in Graph Neural Networks
A multimodal dynamical variational autoencoder for audiovisual speech representation learning
A Model for Every User and Budget: Label-Free and Personalized Mixed-Precision Quantization
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition
Modular Quantization-Aware Training for 6D Object Pose Estimation
QT-DoG: Quantization-aware Training for Domain Generalization
Federated Classification in Hyperbolic Spaces via Secure Aggregation of Convex Hulls
A Resource-Efficient Embedded Iris Recognition System Using Fully Convolutional Networks
EA-3DGS: Efficient and Adaptive 3D Gaussians with Highly Enhanced Quality for outdoor scenes
Ditto: Quantization-aware Secure Inference of Transformers upon MPC
Qu-ANTI-zation: Exploiting Quantization Artifacts for Achieving Adversarial Outcomes
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.