https://github.com/roymiles/simple-recipe-distillation
공식 코드Understanding the Role of the Projector in Knowledge Distillation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Understanding the Role of the Projector in Knowledge Distillation
$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
Recurrent Early Exits for Federated Learning with Heterogeneous Clients
Benchmarking Offline Reinforcement Learning on Real-Robot Hardware
Benchmarking Offline Reinforcement Learning on Real-Robot Hardware
On-orbit model training for satellite imagery with label proportions
Benchmarking MOEAs for solving continuous multi-objective RL problems
NAS-Bench-360: Benchmarking Neural Architecture Search on Diverse Tasks
TFW2V: An Enhanced Document Similarity Method for the Morphologically Rich Finnish Language
Directed Acyclic Graph Factorization Machines for CTR Prediction via Knowledge Distillation
JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models
RecBole 2.0: Towards a More Up-to-Date Recommendation Library
UFIN: Universal Feature Interaction Network for Multi-Domain Click-Through Rate Prediction
TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection
Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical ML
Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical ML
Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical ML
Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical ML
Preserving Linear Separability in Continual Learning by Backward Feature Projection
Benchmarking Object Detectors under Real-World Distribution Shifts in Satellite Imagery
Efficient and Robust Jet Tagging at the LHC with Knowledge Distillation
Better Estimation of the KL Divergence Between Language Models
Operation-Level Performance Benchmarking of Graph Neural Networks for Scientific Applications
Benchmarking Feature-based Algorithm Selection Systems for Black-box Numerical Optimization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.