논문 ID: document/9797749

SentiStory: A Multi-Layered Sentiment-Aware Generative Model for Visual Storytelling

Wei Chen, Xuefeng Liu, Jianwei Niu

제출 2022-06-16

원문 초록

The visual storytelling (VIST) task aims at generating reasonable, human-like and coherent stories with the image streams as input. Although many deep learning models have achieved promising results, most of them do not directly leverage the sentiment information of stories. In this paper, we propose a sentiment-aware generative model for VIST called SentiStory. The key of SentiStory is a multi-layered sentiment extraction module (MLSEM). For a given image stream, the higher layer gives coarse-grained but accurate sentiments, while the lower layer of the MLSEM extracts fine-grained but usually unreliable ones. The two layers are combined strategically to generate coherent and rich visual sentiment concepts for the VIST task. Results from both automatic and human evaluations demonstrate that with the help of the MLSEM, SentiStory achieves improvement in generating more coherent and human-like stories.

함께 살펴볼 논문

공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.

arXiv:2504.12256공통 태그 Visual Storytelling공식 코드 · Papers with Code

FLIP Reasoning Challenge

토론

이 논문과 연결된 포럼 글이 아직 없습니다.