Quantization Mimic: Towards Very Tiny CNN for Object Detection
원문 초록
In this paper, we propose a simple and general framework for training very tiny CNNs for object detection. Due to limited representation ability, it is challenging to train very tiny networks for complicated tasks like detection. To the best of our knowledge, our method, called Quantization Mimic, is the first one focusing on very tiny networks. We utilize two types of acceleration methods: mimic and quantization. Mimic improves the performance of a student network by transfering knowledge from a teacher network. Quantization converts a full-precision network to a quantized one without large degradation of performance. If the teacher network is quantized, the search scope of the student network will be smaller. Using this feature of the quantization, we propose Quantization Mimic. It first quantizes the large network, then mimic a quantized small network. The quantization operation can help student network to better match the feature maps from teacher network. To evaluate our approach, we carry out experiments on various popular CNNs including VGG and Resnet, as well as different detection frameworks including Faster R-CNN and R-FCN. Experiments on Pascal VOC and WIDER FACE verify that our Quantization Mimic algorithm can be applied on various settings and outperforms state-of-the-art model acceleration methods given limited computing resouces.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Towards Reliable Detection of Empty Space: Conditional Marked Point Processes for Object Detection
Multiple Object Stitching for Unsupervised Representation Learning
Domain Randomization for Object Detection in Manufacturing Applications using Synthetic Data: A Comprehensive Study
Edge-Enabled Collaborative Object Detection for Real-Time Multi-Vehicle Perception
A Real-Time System for Egocentric Hand-Object Interaction Detection in Industrial Domains
ECORE: Energy-Conscious Optimized Routing for Deep Learning Models at the Edge
토론
이 논문과 연결된 포럼 글이 아직 없습니다.