Neural Attention for Image Captioning: Review of Outstanding Methods
원문 초록
Image captioning is the task of automatically generating sentences that describe an input image in the best way possible. The most successful techniques for automatically generating image captions have recently used attentive deep learning models. There are variations in the way deep learning models with attention are designed. In this survey, we provide a review of literature related to attentive deep learning models for image captioning. Instead of offering a comprehensive review of all prior work on deep image captioning models, we explain various types of attention mechanisms used for the task of image captioning in deep learning models. The most successful deep learning models used for image captioning follow the encoder-decoder architecture, although there are differences in the way these models employ attention mechanisms. Via analysis on performance results from different attentive deep models for image captioning, we aim at finding the most successful types of attention mechanisms in deep models for image captioning. Soft attention, bottom-up attention, and multi-head attention are the types of attention mechanism widely used in state-of-the-art attentive deep learning models for image captioning. At the current time, the best results are achieved from variants of multi-head attention with bottom-up attention.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Novel Lightweight Transformer with Edge-Aware Fusion for Remote Sensing Image Captioning
Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal Learning
MedBLIP: Fine-tuning BLIP for Medical Image Captioning
Representation Learning through Multimodal Attention and Time-Sync Comments for Affective Video Content Analysis
Hierarchical memory decoder for visual narrating
Improving Diversity and Reducing Redundancy in Paragraph Captions
토론
이 논문과 연결된 포럼 글이 아직 없습니다.