Incorporating Textual Evidence in Visual Storytelling
원문 초록
Previous work on visual storytelling mainly focused on exploring image sequence as evidence for storytelling and neglected textual evidence for guiding story generation. Motivated by human storytelling process which recalls stories for familiar images, we exploit textual evidence from similar images to help generate coherent and meaningful stories. To pick the images which may provide textual experience, we propose a two-step ranking method based on image object recognition techniques. To utilize textual information, we design an extended Seq2Seq model with two-channel encoder and attention. Experiments on the VIST dataset show that our method outperforms state-of-the-art baseline models without heavy engineering.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Consistent Story Generation with Asymmetry Zigzag Sampling
StoryReasoning Dataset: Using Chain-of-Thought for Scene Understanding and Grounded Story Generation
Action2Dialogue: Generating Character-Centric Narratives from Scene-Level Prompts
KAHANI: Culturally-Nuanced Visual Storytelling Pipeline for Non-Western Cultures
Generating Visual Stories with Grounded and Coreferent Characters
StoryWriter: A Multi-Agent Framework for Long Story Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.