https://github.com/dr-bell/kaizen
공식 코드Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning
Exploring Social Media for Early Detection of Depression in COVID-19 Patients
UNIKD: UNcertainty-filtered Incremental Knowledge Distillation for Neural Implicit Representation
VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells
Benchmarking Classic and Learned Navigation in Complex 3D Environments
Dual Correction Strategy for Ranking Distillation in Top-N Recommender System
A novel evaluation methodology for supervised Feature Ranking algorithms
Safety-enhanced UAV Path Planning with Spherical Vector-based Particle Swarm Optimization
Deep Structured Instance Graph for Distilling Object Detectors
Multi-Scale Aligned Distillation for Low-Resolution Detection
LongEmbed: Extending Embedding Models for Long Context Retrieval
HAAQI-Net: A Non-intrusive Neural Music Audio Quality Assessment Model for Hearing Aids
DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil Engineering
Low Complexity Hybrid Beamforming for mmWave Full-Duplex Integrated Access and Backhaul
Robust Knowledge Distillation in Federated Learning: Counteracting Backdoor Attacks
How to Train the Teacher Model for Effective Knowledge Distillation
The Coralscapes Dataset: Semantic Scene Understanding in Coral Reefs
Benchmarking Unsupervised Object Representations for Video Sequences
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.