https://github.com/glory20h/FitHuBERT
공식 코드FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learning
Accurate Peak Detection in Multimodal Optimization via Approximated Landscape Learning
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding
Neptune: The Long Orbit to Benchmarking Long Video Understanding
New Protocols and Negative Results for Textual Entailment Data Collection
Benchmarking Attribution Methods with Relative Feature Importance
Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videos
ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots
AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
Knowledge distillation: A good teacher is patient and consistent
Motley: Benchmarking Heterogeneity and Personalization in Federated Learning
Motley: Benchmarking Heterogeneity and Personalization in Federated Learning
Class-Balanced Distillation for Long-Tailed Visual Recognition
BAM! Born-Again Multi-Task Networks for Natural Language Understanding
Class-Balanced Distillation for Long-Tailed Visual Recognition
Adversarial Environment Generation for Learning to Navigate the Web
F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Models
Accelerating Large-Scale Inference with Anisotropic Vector Quantization
NAS-Bench-101: Towards Reproducible Neural Architecture Search
General Geospatial Inference with a Population Dynamics Foundation Model
RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learning
Deluca -- A Differentiable Control Library: Environments, Methods, and Benchmarking
HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoning
BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimation
DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.