Deep Networks With Large Output Spaces
원문 초록
Deep neural networks have been extremely successful at various image, speech, video recognition tasks because of their ability to model deep structures within the data. However, they are still prohibitively expensive to train and apply for problems containing millions of classes in the output layer. Based on the observation that the key computation common to most neural network layers is a vector/matrix product, we propose a fast locality-sensitive hashing technique to approximate the actual dot product enabling us to scale up the training and inference to millions of output classes. We evaluate our technique on three diverse large-scale recognition tasks and show that our approach can train large-scale models at a faster rate (in terms of steps/total time) compared to baseline methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DVFL-Net: A Lightweight Distilled Video Focal Modulation Network for Spatio-Temporal Action Recognition
VCRBench: Exploring Long-form Causal Reasoning Capabilities of Large Video Language Models
BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimation
PAVE: Patching and Adapting Video Large Language Models
VideoPure: Diffusion-based Adversarial Purification for Video Recognition
Uni-AdaFocus: Spatial-temporal Dynamic Computation for Video Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.