Papers with Code 아카이브

Knowledge Distillation

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법 전체 데이터셋

하위 태스크: 2
평가표: 11
보존된 평가 기록: 90

Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/KULeuven-MICAS/zigzag-imc

공식 코드

Analog or Digital In-memory Computing? Benchmarking through Quantitative Modeling

https://github.com/KV-Park/PINT

공식 코드

PINT: Physics-Informed Neural Time Series Models with Applications to Long-term Inference on WeatherBench 2m-Temperature Data

https://github.com/KaiyangZhou/deep-person-reid

공식 코드

Torchreid: A Library for Deep Learning Person Re-Identification in Pytorch

https://github.com/Kami-code/dexart-release

공식 코드

DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects

https://github.com/Kennethborup/self_distillation

공식 코드

Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation

https://github.com/Khayrulbuet13/LymphoML

공식 코드

Real-Time Cell Sorting with Scalable In Situ FPGA-Accelerated Deep Learning

https://github.com/Khurramjaved96/incremental-learning

공식 코드

Revisiting Distillation and Incremental Classifier Learning

https://github.com/Kinds-of-Intelligence-CFI/PredictaBoard

공식 코드

PredictaBoard: Benchmarking LLM Score Predictability

https://github.com/KiseKloset/DM-VTON

공식 코드

DM-VTON: Distilled Mobile Real-time Virtual Try-On

https://github.com/KitwareMedical/habet

공식 코드

Harmonization Benchmarking Tool for Neuroimaging Datasets

https://github.com/Klodivio355/MTL-CV-Review

공식 코드

When Multi-Task Learning Meets Partial Supervision: A Computer Vision Review

https://github.com/KrishnaTarun/Unification

공식 코드

Unifying Synergies between Self-supervised Learning and Dynamic Computation

https://github.com/KyanChen/OvarNet

공식 코드

OvarNet: Towards Open-vocabulary Object Attribute Recognition

https://github.com/LCS2-IIITD/KD_generalization

공식 코드

On the Generalization vs Fidelity Paradox in Knowledge Distillation

https://github.com/LIVIAETS/MT-MTDA

공식 코드

Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation

https://github.com/LMA-NeurIPS19/LMA

공식 코드

Light Multi-segment Activation for Model Compression

https://github.com/LTTM/CCDA

공식 코드

Continual Coarse-to-Fine Domain Adaptation in Semantic Segmentation

https://github.com/LauraMartinus/ukuxhumana

공식 코드

Benchmarking Neural Machine Translation for Southern African Languages

https://github.com/Lee-Gihun/FedNTD

공식 코드

Preservation of the Global Knowledge by Not-True Distillation in Federated Learning

https://github.com/Lee-Gihun/FedSOL

공식 코드

FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning

https://github.com/Leminhbinh0209/AAAI22-ADD

공식 코드

ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images

https://github.com/Leolty/repobench

공식 코드

RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems

https://github.com/LeslieOverfitting/selective_distillation

공식 코드

Selective Knowledge Distillation for Neural Machine Translation

https://github.com/Lhx94As/dual-mode-language-identification

공식 코드

Enhance Language Identification using Dual-mode Model with Knowledge Distillation

https://github.com/LibertFan/AI_Hospital

공식 코드

AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator

https://github.com/LifuWang-66/DistillT5

공식 코드

Scaling Down Text Encoders of Text-to-Image Diffusion Models

https://github.com/Linking-ai/ctm_bench

공식 코드

Benchmarking Temporal Reasoning and Alignment Across Chinese Dynasties

https://github.com/Linwenye/Efficient-KD

공식 코드

Efficient Sub-structured Knowledge Distillation

https://github.com/LiuShiBen/DAFC

공식 코드

Distribution-aware Forgetting Compensation for Exemplar-Free Lifelong Person Re-identification

https://github.com/LiuShiBen/DCR

공식 코드

Domain Consistency Representation Learning for Lifelong Person Re-Identification

https://github.com/Liyue-Chen/STCFP_CONTEXT

공식 코드

Exploring Context Generalizability in Citywide Crowd Mobility Prediction: An Analytic Framework and Benchmark

https://github.com/LorenzoBini4/FlowCyt-Classification-Benchmark

공식 코드

FlowCyt: A Comparative Study of Deep Learning Approaches for Multi-Class Classification in Flow Cytometry Benchmarking

https://github.com/LuciusLan/Visual-RAG

공식 코드

Visual-RAG: Benchmarking Text-to-Image Retrieval Augmented Generation for Visual Knowledge Intensive Queries

https://github.com/Lumen-Laboratory/OpenGrok

공식 코드

OpenGrok: Enhancing SNS Data Processing with Distilled Knowledge and Mask-like Mechanisms

https://github.com/Lvchangze/SpikeBERT

공식 코드

SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation

https://github.com/MANGA-UOFA/M-DAT

공식 코드

Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.