Imagining from Images with an AI Storytelling Tool
원문 초록
A method for generating narratives by analyzing single images or image sequences is presented, inspired by the time immemorial tradition of Narrative Art. The proposed method explores the multimodal capabilities of GPT-4o to interpret visual content and create engaging stories, which are illustrated by a Stable Diffusion XL model. The method is supported by a fully implemented tool, called ImageTeller, which accepts images from diverse sources as input. Users can guide the narrative's development according to the conventions of fundamental genres - such as Comedy, Romance, Tragedy, Satire or Mystery -, opt to generate data-driven stories, or to leave the prototype free to decide how to handle the narrative structure. User interaction is provided along the generation process, allowing the user to request alternative chapters or illustrations, and even reject and restart the story generation based on the same input. Additionally, users can attach captions to the input images, influencing the system's interpretation of the visual content. Examples of generated stories are provided, along with details on how to access the prototype.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
StoryWriter: A Multi-Agent Framework for Long Story Generation
Consistent Story Generation with Asymmetry Zigzag Sampling
Counterfactual reasoning: an analysis of in-context emergence
StoryReasoning Dataset: Using Chain-of-Thought for Scene Understanding and Grounded Story Generation
Learning to Reason for Long-Form Story Generation
Whose story is it? Personalizing story generation by inferring author styles
토론
이 논문과 연결된 포럼 글이 아직 없습니다.