https://github.com/snoop2head/Deep-Encoder-Shallow-Decoder
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation
Ensemble Knowledge Distillation for Learning Improved and Efficient Networks
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Graph-based Knowledge Distillation by Multi-head Attention Network
Multiple Instance Learning: A Survey of Problem Characteristics and Applications
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
OpenOOD: Benchmarking Generalized Out-of-Distribution Detection
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
ZeroGen: Efficient Zero-shot Learning via Dataset Generation
Attend, Distill, Detect: Attention-aware Entropy Distillation for Anomaly Detection
The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.