Papers with Code 아카이브
Knowledge Distillation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 2
- 평가표
- 11
- 보존된 평가 기록
- 90
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Inaugural MOASEI Competition at AAMAS'2025: A Technical Report
LLMThinkBench: Towards Basic Math Reasoning and Overthinking in Large Language Models
GDGB: A Benchmark for Generative Dynamic Text-Attributed Graph Learning
STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarking
Latent Thermodynamic Flows: Unified Representation Learning and Generative Modeling of Temperature-Dependent Behaviors from Limited Data
LANTERN: A Machine Learning Framework for Lipid Nanoparticle Transfection Efficiency Prediction
CORE: Benchmarking LLMs Code Reasoning Capabilities through Static Analysis Tasks
TransLaw: Benchmarking Large Language Models in Multi-Agent Simulation of the Collaborative Translation
The Trilemma of Truth in Large Language Models
State and Memory is All You Need for Robust and Reliable AI Agents
Point Cloud Compression and Objective Quality Assessment: A Survey
Layer Importance for Mathematical Reasoning is Forged in Pre-Training and Invariant after Post-Training
Distilling Normalizing Flows
CovDocker: Benchmarking Covalent Drug Design with Tasks, Datasets, and Solutions
FeDa4Fair: Client-Level Federated Datasets for Fairness Evaluation
Continual Self-Supervised Learning with Masked Autoencoders in Remote Sensing
Benchmarking Deep Learning and Vision Foundation Models for Atypical vs. Normal Mitosis Classification with Cross-Dataset Evaluation
Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge
G$^{2}$D: Boosting Multimodal Learning with Gradient-Guided Distillation
mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale
Multimodal Information Retrieval for Open World with Edit Distance Weak Supervision
A Survey of Predictive Maintenance Methods: An Analysis of Prognostics via Classification and Regression
BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videos
Towards Scalable and Generalizable Earth Observation Data Mining via Foundation Model Composition
FedBKD: Distilled Federated Learning to Embrace Gerneralization and Personalization on Non-IID Data
Client Clustering Meets Knowledge Sharing: Enhancing Privacy and Robustness in Personalized Peer-to-Peer Learning
Tackling Data Heterogeneity in Federated Learning through Knowledge Distillation with Inequitable Aggregation
WattsOnAI: Measuring, Analyzing, and Visualizing Energy and Carbon Footprint of AI Workloads
HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interaction
Benchmarking Unsupervised Strategies for Anomaly Detection in Multivariate Time Series
Building Lightweight Semantic Segmentation Models for Aerial Images Using Dual Relation Distillation
scMamba: A Scalable Foundation Model for Single-Cell Multi-Omics Integration Beyond Highly Variable Feature Selection
inMOTIFin: a lightweight end-to-end simulation software for regulatory sequences
AI-Driven MRI-based Brain Tumour Segmentation Benchmarking
FixCLR: Negative-Class Contrastive Learning for Semi-Supervised Domain Generalization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.