Revisiting Knowledge Distillation for Object Detection
원문 초록
The existing solutions for object detection distillation rely on the availability of both a teacher model and ground-truth labels. We propose a new perspective to relax this constraint. In our framework, a student is first trained with pseudo labels generated by the teacher, and then fine-tuned using labeled data, if any available. Extensive experiments demonstrate improvements over existing object detection distillation algorithms. In addition, decoupling the teacher and ground-truth distillation in this framework provides interesting properties such: as 1) using unlabeled data to further improve the student's performance, 2) combining multiple teacher models of different architectures, even with different object categories, and 3) reducing the need for labeled data (with only 20% of COCO labels, this method achieves the same performance as the model trained on the entire set of labels). Furthermore, a by-product of this approach is the potential usage for domain adaptation. We verify these properties through extensive experiments.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Domain-Adaptive Object Detection via Uncertainty-Aware Distribution Alignment
Towards Reliable Detection of Empty Space: Conditional Marked Point Processes for Object Detection
A Real-Time System for Egocentric Hand-Object Interaction Detection in Industrial Domains
ECORE: Energy-Conscious Optimized Routing for Deep Learning Models at the Edge
DuET: Dual Incremental Object Detection via Exemplar-Free Task Arithmetic
Class Agnostic Instance-level Descriptor for Visual Instance Search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.