arXiv:2203.14263
A General Survey on Attention Mechanisms in Deep Learning
원문 초록
Attention is an important mechanism that can be employed for a variety of deep learning models across many different domains and tasks. This survey provides an overview of the most important attention mechanisms proposed in the literature. The various attention mechanisms are explained by means of a framework consisting of a general attention model, uniform notation, and a comprehensive taxonomy of attention mechanisms. Furthermore, the various measures for evaluating attention models are reviewed, and methods to characterize the structure of attention models based on the proposed framework are discussed. Last, future work in the field of attention models is considered.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Survey on Prompt Tuning
A Survey on Latent Reasoning
A Survey on Vision-Language-Action Models for Autonomous Driving
From Tiny Machine Learning to Tiny Deep Learning: A Survey
A Comprehensive Survey on Continual Learning in Generative Models
A Survey on World Models Grounded in Acoustic Physical Information
토론
이 논문과 연결된 포럼 글이 아직 없습니다.