A Pipeline for Creative Visual Storytelling
원문 초록
Computational visual storytelling produces a textual description of events and interpretations depicted in a sequence of images. These texts are made possible by advances and cross-disciplinary approaches in natural language processing, generation, and computer vision. We define a computational creative visual storytelling as one with the ability to alter the telling of a story along three aspects: to speak about different environments, to produce variations based on narrative goals, and to adapt the narrative to the audience. These aspects of creative storytelling and their effect on the narrative have yet to be explored in visual storytelling. This paper presents a pipeline of task-modules, Object Identification, Single-Image Inferencing, and Multi-Image Narration, that serve as a preliminary design for building a creative visual storyteller. We have piloted this design for a sequence of images in an annotation task. We present and analyze the collected corpus and describe plans towards automation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Consistent Story Generation with Asymmetry Zigzag Sampling
StoryReasoning Dataset: Using Chain-of-Thought for Scene Understanding and Grounded Story Generation
FLIP Reasoning Challenge
FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations
Multimodal Large Language Models and Tunings: Vision, Language, Sensors, Audio, and Beyond
Alfie: Democratising RGBA Image Generation With No $$$
토론
이 논문과 연결된 포럼 글이 아직 없습니다.