Let Storytelling Tell Vivid Stories: An Expressive and Fluent Multimodal Storyteller
원문 초록
Storytelling aims to generate reasonable and vivid narratives based on an ordered image stream. The fidelity to the image story theme and the divergence of story plots attract readers to keep reading. Previous works iteratively improved the alignment of multiple modalities but ultimately resulted in the generation of simplistic storylines for image streams. In this work, we propose a new pipeline, termed LLaMS, to generate multimodal human-level stories that are embodied in expressiveness and consistency. Specifically, by fully exploiting the commonsense knowledge within the LLM, we first employ a sequence data auto-enhancement strategy to enhance factual content expression and leverage a textual reasoning architecture for expressive story generation and prediction. Secondly, we propose SQ-Adatpter module for story illustration generation which can maintain sequence consistency. Numerical results are conducted through human evaluation to verify the superiority of proposed LLaMS. Evaluations show that LLaMS achieves state-of-the-art storytelling performance and 86% correlation and 100% consistency win rate as compared with previous SOTA methods. Furthermore, ablation experiments are conducted to verify the effectiveness of proposed sequence data enhancement and SQ-Adapter.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
StoryWriter: A Multi-Agent Framework for Long Story Generation
Consistent Story Generation with Asymmetry Zigzag Sampling
Counterfactual reasoning: an analysis of in-context emergence
StoryReasoning Dataset: Using Chain-of-Thought for Scene Understanding and Grounded Story Generation
Learning to Reason for Long-Form Story Generation
Whose story is it? Personalizing story generation by inferring author styles
토론
이 논문과 연결된 포럼 글이 아직 없습니다.