Image Representations and New Domains in Neural Image Captioning
원문 초록
We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a state-of-the-art neural captioning algorithm is able to produce quality captions even when provided with surprisingly poor image representations. We replicate this result in a new, fine-grained, transfer learned captioning domain, consisting of 66K recipe image/title pairs. We also provide some experiments regarding the appropriateness of datasets for automatic captioning, and find that having multiple captions per image is beneficial, but not an absolute requirement.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic Cognition
Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation
Group-based Distinctive Image Captioning with Memory Difference Encoding and Attention
Fine-Grained Video Captioning through Scene Graph Consolidation
FE-LWS: Refined Image-Text Representations via Decoder Stacking and Fused Encodings for Remote Sensing Image Captioning
Unleashing Text-to-Image Diffusion Prior for Zero-Shot Image Captioning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.