Measuring Information Distortion in Hierarchical Ultra long Novel Generation:The Optimal Expansion Ratio
원문 초록
Writing novels with Large Language Models (LLMs) raises a critical question: how much human-authored outline is necessary to generate high-quality million-word novels? While frameworks such as DOME, Plan&Write, and Long Writer have improved stylistic coherence and logical consistency, they primarily target shorter novels (10k--100k words), leaving ultra-long generation largely unexplored. Drawing on insights from recent text compression methods like LLMZip and LLM2Vec, we conduct an information-theoretic analysis that quantifies distortion occurring when LLMs compress and reconstruct ultra-long novels under varying compression-expansion ratios. We introduce a hierarchical two-stage generation pipeline (outline -> detailed outline -> manuscript) and find an optimal outline length that balances information preservation with human effort. Through extensive experimentation with Chinese novels, we establish that a two-stage hierarchical outline approach significantly reduces semantic distortion compared to single-stage methods. Our findings provide empirically-grounded guidance for authors and researchers collaborating with LLMs to create million-word novels.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
TokAlign: Efficient Vocabulary Adaptation via Token Alignment
Scaling Multi-Document Event Summarization: Evaluating Compression vs. Full-Text Approaches
L3TC: Leveraging RWKV for Learned Lossless Low-Complexity Text Compression
IntellectSeeker: A Personalized Literature Management System with the Probabilistic Model and Large Language Model
FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression
AlphaZip: Neural Network-Enhanced Lossless Text Compression
토론
이 논문과 연결된 포럼 글이 아직 없습니다.