arXiv:2209.12817
Word to Sentence Visual Semantic Similarity for Caption Generation: Lessons Learned
원문 초록
This paper focuses on enhancing the captions generated by image-caption generation systems. We propose an approach for improving caption generation systems by choosing the most closely related output to the image rather than the most likely output produced by the model. Our model revises the language generation output beam search from a visual context perspective. We employ a visual semantic measure in a word and sentence level manner to match the proper caption to the related information in the image. The proposed approach can be applied to any caption system as a post-processing based method.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Smoothie: Smoothing Diffusion on Token Embeddings for Text Generation
LLMs Are Not Scorers: Rethinking MT Evaluation with Generation-Based Methods
SemCSE: Semantic Contrastive Sentence Embeddings Using LLM-Generated Summaries For Scientific Abstracts
DALR: Dual-level Alignment Learning for Multimodal Sentence Representation Learning
Enhancing Automatic Term Extraction with Large Language Models via Syntactic Retrieval
Intrinsic vs. Extrinsic Evaluation of Czech Sentence Embeddings: Semantic Relevance Doesn't Help with MT Evaluation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.