MED-TEX: Transferring and Explaining Knowledge with Less Data from Pretrained Medical Imaging Models
원문 초록
Deep learning methods usually require a large amount of training data and lack interpretability. In this paper, we propose a novel knowledge distillation and model interpretation framework for medical image classification that jointly solves the above two issues. Specifically, to address the data-hungry issue, a small student model is learned with less data by distilling knowledge from a cumbersome pretrained teacher model. To interpret the teacher model and assist the learning of the student, an explainer module is introduced to highlight the regions of an input that are important for the predictions of the teacher model. Furthermore, the joint framework is trained by a principled way derived from the information-theoretic perspective. Our framework outperforms on the knowledge distillation and model interpretation tasks compared to state-of-the-art methods on a fundus dataset.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SeqPE: Transformer with Sequential Position Encoding
Deep Modeling and Optimization of Medical Image Classification
Advancements in Medical Image Classification through Fine-Tuning Natural Domain Foundation Models
FedGSCA: Medical Federated Learning with Global Sample Selector and Client Adaptive Adjuster under Label Noise
Robust Training with Data Augmentation for Medical Imaging Classification
Finding Optimal Kernel Size and Dimension in Convolutional Neural Networks An Architecture Optimization Approach
토론
이 논문과 연결된 포럼 글이 아직 없습니다.