https://github.com/cvblab/kd_resolution
공식 코드Attention to detail: inter-resolution knowledge distillation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Attention to detail: inter-resolution knowledge distillation
Attention to detail: inter-resolution knowledge distillation
Tune It or Don't Use It: Benchmarking Data-Efficient Image Classification
Rethinking Resolution in the Context of Efficient Video Recognition
Towards Efficient 3D Object Detection with Knowledge Distillation
A Continuous Optimisation Benchmark Suite from Neural Network Regression
Better Late Than Never: Formulating and Benchmarking Recommendation Editing
Needle In A Haystack, Fast: Benchmarking Image Perceptual Similarity Metrics At Scale
New Insights on Relieving Task-Recency Bias for Online Class Incremental Learning
Learning to Learn Parameterized Classification Networks for Scalable Input Images
A Benchmarking Dataset with 2440 Organic Molecules for Volume Distribution at Steady State
Implicit Chain of Thought Reasoning via Knowledge Distillation
Aquatic Navigation: A Challenging Benchmark for Deep Reinforcement Learning
Benchmarking Robustness of Deep Learning Classifiers Using Two-Factor Perturbation
Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Models
Efficient Ternary Weight Embedding Model: Bridging Scalability and Performance
ArabicaQA: A Comprehensive Dataset for Arabic Question Answering
A Framework for Evaluating PM2.5 Forecasts from the Perspective of Individual Decision Making
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation
BLEND: Behavior-guided Neural Population Dynamics Modeling via Privileged Knowledge Distillation
Mol-MoE: Training Preference-Guided Routers for Molecule Generation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.