https://github.com/cordercorder/quant_eval
공식 코드A Comprehensive Evaluation of Quantization Strategies for Large Language Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).
Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
A Comprehensive Evaluation of Quantization Strategies for Large Language Models
Seizure Detection and Prediction by Parallel Memristive Convolutional Neural Networks
QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks
Precision Gating: Improving Neural Network Efficiency with Dynamic Dual-Precision Activations
Improving Neural Network Quantization without Retraining using Outlier Channel Splitting
Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
Design Methodology for Deep Out-of-Distribution Detectors in Real-Time Cyber-Physical Systems
Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generation
IntLoRA: Integral Low-rank Adaptation of Quantized Diffusion Models
GQFedWAvg: Optimization-Based Quantized Federated Learning in General Edge Computing Systems
MetaAug: Meta-Data Augmentation for Post-Training Quantization
MetaAug: Meta-Data Augmentation for Post-Training Quantization
FretNet: Continuous-Valued Pitch Contour Streaming for Polyphonic Guitar Tablature Transcription
ECQ$^{\text{x}}$: Explainability-Driven Quantization for Low-Bit and Sparse DNNs
Tiny Reinforcement Learning for Quadruped Locomotion using Decision Transformers
Integrated Encoding and Quantization to Enhance Quanvolutional Neural Networks
Vector Quantized Time Series Generation with a Bidirectional Prior Model
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision
Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization
A Thorough Examination of Decoding Methods in the Era of LLMs
Random and Adversarial Bit Error Robustness: Energy-Efficient and Secure DNN Accelerators
NF4 Isn't Information Theoretically Optimal (and that's Good)
Model Quantization and Hardware Acceleration for Vision Transformers: A Comprehensive Survey
BitDecoding: Unlocking Tensor Cores for Long-Context LLMs Decoding with Low-Bit KV Cache
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.