Papers with Code 아카이브

Knowledge Distillation

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법 전체 데이터셋

하위 태스크: 2
평가표: 11
보존된 평가 기록: 90

Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/niklasrisse/vpp_label_accuracy

공식 코드

Uncovering the Limits of Machine Learning for Automatic Vulnerability Detection

https://github.com/nikvaessen/w2v2-batch-size

공식 코드

The Effect of Batch Size on Contrastive Self-Supervised Speech Representation Learning

https://github.com/ningljy/dtdbd

공식 코드

Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detection

https://github.com/nis-research/corruptionbenchcv

공식 코드

A Survey on the Robustness of Computer Vision Models against Common Corruptions

https://github.com/nitaytech/kd4gen

공식 코드

A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training

https://github.com/niutrans/niutensor

공식 코드

The NiuTrans System for WNGT 2020 Efficiency Task

https://github.com/nizhenliang/Dual-Relation-Knowledge-Distillation

공식 코드

Dual Relation Knowledge Distillation for Object Detection

https://github.com/nju-websoft/HuggingBench

공식 코드

Benchmarking Recommendation, Classification, and Tracing Based on Hugging Face Knowledge Graph

https://github.com/nju-websoft/OpenEA

공식 코드

A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphs

https://github.com/nju-websoft/cear

공식 코드

Improving Continual Relation Extraction by Distinguishing Analogous Semantics

https://github.com/nju-websoft/eventea

공식 코드

EventEA: Benchmarking Entity Alignment for Event-centric Knowledge Graphs

https://github.com/nju-websoft/mukge

공식 코드

Joint Pre-training and Local Re-training: Transferable Representation Learning on Multi-source Knowledge Graphs

https://github.com/nju-websoft/sckd

공식 코드

Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction

https://github.com/njucckevin/knowcap

공식 코드

Beyond Generic: Enhancing Image Captioning with Real-World Knowledge using Vision-Language Pre-Training Model

https://github.com/njulus/ST

공식 코드

Towards Enabling Meta-Learning from Target Models

https://github.com/njulus/gkd

공식 코드

Generalized Knowledge Distillation via Relationship Matching

https://github.com/nl2code/codes

공식 코드

CodeS: Natural Language to Code Repository via Multi-Layer Sketch

https://github.com/nlie2/triage

공식 코드

TRIAGE: Ethical Benchmarking of AI Models Through Mass Casualty Simulations

https://github.com/nliulab/mimic4ed-benchmark

공식 코드

Benchmarking emergency department triage prediction models with machine learning and large public electronic health records

https://github.com/nlp-uoregon/famie

공식 코드

FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction

https://github.com/nlp-waseda/traveling-across-languages

공식 코드

Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMs

https://github.com/nlp2ct/detectrl

공식 코드

DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarios

https://github.com/nlpcode/tubench

공식 코드

TUBench: Benchmarking Large Vision-Language Models on Trustworthiness with Unanswerable Questions

https://github.com/nlpforua/zno

공식 코드

ZNO-Eval: Benchmarking reasoning capabilities of large language models in Ukrainian

https://github.com/nlpie-research/compact-biomedical-transformers

공식 코드

On the Effectiveness of Compact Biomedical Transformers

https://github.com/nlpie-research/lightweight-clinical-transformers

공식 코드

Lightweight Transformers for Clinical Natural Language Processing

https://github.com/nlpyang/NoisySumm

공식 코드

Noisy Self-Knowledge Distillation for Text Summarization

https://github.com/noahzn/ddnd

공식 코드

Channel-Aware Distillation Transformer for Depth Estimation on Nano Drones

https://github.com/noakliu/efficient-foundation-models-survey

공식 코드

Designing Large Foundation Models for Efficient Training and Inference: A Survey

https://github.com/nobel861017/distort-robust-distilssl

공식 코드

Improving generalizability of distilled self-supervised speech processing models under distorted settings

https://github.com/noen61/mvd

공식 코드

Towards Better Entity Linking with Multi-View Enhanced Distillation

https://github.com/nogrady/ldp-dl

공식 코드

Locally Differentially Private Distributed Deep Learning via Knowledge Distillation

https://github.com/noheadwuzonglin/mca-bench

공식 코드

MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attacks

https://github.com/nojhan/IOHexperimenter

공식 코드

Towards Large Scale Automated Algorithm Design by Integrating Modular Benchmarking Frameworks

https://github.com/nojhan/paradiseo

공식 코드

Towards Large Scale Automated Algorithm Design by Integrating Modular Benchmarking Frameworks

https://github.com/nokiroki/recsys-evaluation-of-dozens-datasets

공식 코드

From Variability to Stability: Advancing RecSys Benchmarking Practices

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.