https://github.com/BaguaSys/bagua
공식 코드BAGUA: Scaling up Distributed Learning with System Relaxations
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).
Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
BAGUA: Scaling up Distributed Learning with System Relaxations
EDA-DM: Enhanced Distribution Alignment for Post-Training Quantization of Diffusion Models
TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids
APNN-TC: Accelerating Arbitrary Precision Neural Networks on Ampere GPU Tensor Cores
Communication Efficient Private Federated Learning Using Dithering
TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation
Neural Network Activation Quantization with Bitwise Information Bottlenecks
MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion
FAT: Learning Low-Bitwidth Parametric Representation via Frequency-Aware Transformation
AdaBM: On-the-Fly Adaptive Bit Mapping for Image Super-Resolution
DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networks
QuIP: 2-Bit Quantization of Large Language Models With Guarantees
QTIP: Quantization with Trellises and Incoherence Processing
DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing
Evaluating Quantized Large Language Models for Code Generation on Low-Resource Language Benchmarks
LiteVAR: Compressing Visual Autoregressive Modelling with Efficient Attention and Quantization
PROFIT: A Novel Training Method for sub-4-bit MobileNet Models
Enhancing Autonomous Driving Systems with On-Board Deployed Large Language Models
AdaLog: Post-Training Quantization for Vision Transformers with Adaptive Logarithm Quantizer
VecQ: Minimal Loss DNN Model Compression With Vectorized Weight Quantization
An Underexplored Dilemma between Confidence and Calibration in Quantized Neural Networks
QQQ: Quality Quattuor-Bit Quantization for Large Language Models
Joint Maximum Purity Forest with Application to Image Super-Resolution
Low-Precision Random Fourier Features for Memory-Constrained Kernel Approximation
Efficient Integer-Arithmetic-Only Convolutional Neural Networks
Efficient Text-driven Motion Generation via Latent Consistency Training
UniTTS: An end-to-end TTS system without decoupling of acoustic and semantic information
Algorithm and VLSI Design for 1-bit Data Detection in Massive MIMO-OFDM
Unsupervised Speech Representation Pooling Using Vector Quantization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.