Knowledge Distillation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 2
- 평가표
- 11
- 보존된 평가 기록
- 90
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/2024-MindSpore-1/Code4/tree/main/RetinaNet
https://github.com/2024-MindSpore-1/Code5/tree/main/AlphaPose
AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time
https://github.com/2024-MindSpore-1/Code6/tree/main/AlphaPose
AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time
https://github.com/2024-MindSpore-1/Code7/tree/main/cnn_direction_model
https://github.com/329tyson/fai-ssl-challenge
Scaling and Benchmarking Self-Supervised Visual Representation Learning
https://github.com/497626895/darknet
https://github.com/ACEsuit/mace
Matbench Discovery -- A framework to evaluate machine learning crystal stability predictions
https://github.com/AFAgarap/cnn-svm
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
https://github.com/AI4LIFE-GROUP/LLM_Explainer
OpenXAI: Towards a Transparent Evaluation of Model Explanations
https://github.com/Abdulk084/Intent_classification
An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction
https://github.com/AcutronicRobotics/gym-gazebo2
gym-gazebo2, a toolkit for reinforcement learning using ROS 2 and Gazebo
https://github.com/AdeelH/pytorch-multi-class-focal-loss
https://github.com/Adlik/model_optimizer
https://github.com/AiLvv/mmdetection
https://github.com/AleksBanbur/EE8204---Real-Time-Multi-Task-Learning
Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations
https://github.com/AlexandrosFerles/NIPS_2019_Reproducibilty_Challenge_Zero-shot_Knowledge_Transfer_via_Adversarial_Belief_Matching
https://github.com/AlexeyAB/darknet
https://github.com/AllenPeng0209/SaccadeNet
https://github.com/AmazingDD/daisyRec
DaisyRec 2.0: Benchmarking Recommendation for Rigorous Evaluation
https://github.com/AmenRa/rank_eval
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
https://github.com/AndreiMoraru123/Hydra
Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations
https://github.com/AndresPMD/Clip_CMR
Learning Transferable Visual Models From Natural Language Supervision
https://github.com/AngusG/cleverhans-attacking-bnns
Technical Report on the CleverHans v2.1.0 Adversarial Examples Library
https://github.com/Ankur3107/awesome-daily-blog
TextKD-GAN: Text Generation using KnowledgeDistillation and Generative Adversarial Networks
https://github.com/Anon6627/KD-UDA
Joint Progressive Knowledge Distillation and Unsupervised Domain Adaptation
https://github.com/ArchieMeng/realsr-ncnn-vulkan-python
NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Results
https://github.com/Arthurizijar/Bert_Airport
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
https://github.com/AtlasCoCo/Darknet
https://github.com/Audio-WestlakeU/ATST-SED
Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Tasks
https://github.com/Autonomous-Visual-Perception/detection-benchmark
https://github.com/AwesumMe/RetailClassification
https://github.com/AxelvL/AHPQ.jl
Accelerating Large-Scale Inference with Anisotropic Vector Quantization
https://github.com/BKAUTO/Trinocular-habitat-sim
https://github.com/BM-K/KoSentenceBERT
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation
https://github.com/BM-K/KoSentenceBERT_ETRI
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.