arXiv:1901.08942
Improving Image Captioning by Leveraging Knowledge Graphs
원문 초록
We explore the use of a knowledge graphs, that capture general or commonsense knowledge, to augment the information extracted from images by the state-of-the-art methods for image captioning. The results of our experiments, on several benchmark data sets such as MS COCO, as measured by CIDEr-D, a performance metric for image captioning, show that the variants of the state-of-the-art methods for image captioning that make use of the information extracted from knowledge graphs can substantially outperform those that rely solely on the information extracted from images.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Graph Collaborative Attention Network for Link Prediction in Knowledge Graphs
A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs
Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answering
Vision Matters: Simple Visual Perturbations Can Boost Multimodal Math Reasoning
ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMs
Dense Retrievers Can Fail on Simple Queries: Revealing The Granularity Dilemma of Embeddings
토론
이 논문과 연결된 포럼 글이 아직 없습니다.