https://github.com/lancopku/dynamickd
공식 코드Dynamic Knowledge Distillation for Pre-trained Language Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Knowledge distillation is the process of transferring knowledge from a large model to a smaller one. While large models (such as very deep neural networks or ensembles of many models) have higher knowledge capacity than small models, this capacity might not be fully utilized.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Dynamic Knowledge Distillation for Pre-trained Language Models
Gradient Knowledge Distillation for Pre-trained Language Models
MT-LENS: An all-in-one Toolkit for Better Machine Translation Evaluation
TuringQ: Benchmarking AI Comprehension in Theory of Computation
OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversion
Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models
CAVIAR: Co-simulation of 6G Communications, 3D Scenarios and AI for Digital Twins
Benchmarking Unsupervised Strategies for Anomaly Detection in Multivariate Time Series
Benchmarking Robust Self-Supervised Learning Across Diverse Downstream Tasks
LoTa-Bench: Benchmarking Language-oriented Task Planners for Embodied Agents
Causality-enhanced Decision-Making for Autonomous Mobile Robots in Dynamic Environments
Building Conformal Prediction Intervals with Approximate Message Passing
Revisiting Hate Speech Benchmarks: From Data Curation to System Deployment
Probing Critical Learning Dynamics of PLMs for Hate Speech Detection
One Step Diffusion-based Super-Resolution with Time-Aware Distillation
Why do tree-based models still outperform deep learning on tabular data?
Bencher: Simple and Reproducible Benchmarking for Black-Box Optimization
InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Models
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction
Benchmarking Instance-Centric Counterfactual Algorithms for XAI: From White Box to Black Box
Distilling Knowledge for Designing Computational Imaging Systems
What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models
Mamba-Based Ensemble learning for White Blood Cell Classification
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.