Image Captioning with Object Detection and Localization
원문 초록
Automatically generating a natural language description of an image is a task close to the heart of image understanding. In this paper, we present a multi-model neural network method closely related to the human visual system that automatically learns to describe the content of images. Our model consists of two sub-models: an object detection and localization model, which extract the information of objects and their spatial relationship in images respectively; Besides, a deep recurrent neural network (RNN) based on long short-term memory (LSTM) units with attention mechanism for sentences generation. Each word of the description will be automatically aligned to different objects of the input image when it is generated. This is similar to the attention mechanism of the human visual system. Experimental results on the COCO dataset showcase the merit of the proposed method, which outperforms previous benchmark models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Global Object Proposals for Improving Multi-Sentence Video Descriptions
Universal Fine-grained Visual Categorization by Concept Guided Learning
Integrity Assessment of Maritime Object Detection Impacted by Partial Camera Obstruction
Ensemble Fusion for Small Object Detection
Small Object Detection for Birds with Swin Transformer
Domain Generalized Object Detection for Remote Sensing Images
토론
이 논문과 연결된 포럼 글이 아직 없습니다.