https://github.com/dd-duda/bitdistiller
공식 코드BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).
Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding
Anonymizing Speech: Evaluating and Designing Speaker Anonymization Techniques
VQ-GNN: A Universal Framework to Scale up Graph Neural Networks using Vector Quantization
A Physics-Informed Vector Quantized Autoencoder for Data Compression of Turbulent Flow
The Ecological Footprint of Neural Machine Translation Systems
Efficient Video Face Enhancement with Enhanced Spatial-Temporal Consistency
TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones
Sub-token ViT Embedding via Stochastic Resonance Transformers
Learning Accurate Low-Bit Deep Neural Networks with Stochastic Quantization
Accelerating Antimicrobial Peptide Discovery with Latent Structure
MAexp: A Generic Platform for RL-based Multi-Agent Exploration
Fast Inference of Mixture-of-Experts Language Models with Offloading
Model Compression Techniques in Biometrics Applications: A Survey
Edge AI-Based Vein Detector for Efficient Venipuncture in the Antecubital Fossa
Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
NeUQI: Near-Optimal Uniform Quantization Parameter Initialization
Exploring Quantization and Mapping Synergy in Hardware-Aware Deep Neural Network Accelerators
LoRANN: Low-Rank Matrix Factorization for Approximate Nearest Neighbor Search
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.