Low Power Inference for On-Device Visual Recognition with a Quantization-Friendly Solution
원문 초록
The IEEE Low-Power Image Recognition Challenge (LPIRC) is an annual competition started in 2015 that encourages joint hardware and software solutions for computer vision systems with low latency and power. Track 1 of the competition in 2018 focused on the innovation of software solutions with fixed inference engine and hardware. This decision allows participants to submit models online and not worry about building and bringing custom hardware on-site, which attracted a historically large number of submissions. Among the diverse solutions, the winning solution proposed a quantization-friendly framework for MobileNets that achieves an accuracy of 72.67% on the holdout dataset with an average latency of 27ms on a single CPU core of Google Pixel2 phone, which is superior to the best real-time MobileNet models at the time.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization
Implementing Keyword Spotting on the MCXN947 Microcontroller with Integrated NPU
Variational Bayesian Channel Estimation and Data Detection for Cell-Free Massive MIMO with Low-Resolution Quantized Fronthaul Links
MNN-LLM: A Generic Inference Engine for Fast Large Language Model Deployment on Mobile Devices
FastMamba: A High-Speed and Efficient Mamba Accelerator on FPGA with Accurate Quantization
Harnessing Large Language Models Locally: Empirical Results and Implications for AI PC
토론
이 논문과 연결된 포럼 글이 아직 없습니다.