Long-Form Text-to-Music Generation with Adaptive Prompts: A Case Study in Tabletop Role-Playing Games Soundtracks
원문 초록
This paper investigates the capabilities of text-to-audio music generation models in producing long-form music with prompts that change over time, focusing on soundtrack generation for Tabletop Role-Playing Games (TRPGs). We introduce Babel Bardo, a system that uses Large Language Models (LLMs) to transform speech transcriptions into music descriptions for controlling a text-to-music model. Four versions of Babel Bardo were compared in two TRPG campaigns: a baseline using direct speech transcriptions, and three LLM-based versions with varying approaches to music description generation. Evaluations considered audio quality, story alignment, and transition smoothness. Results indicate that detailed music descriptions improve audio quality while maintaining consistency across consecutive descriptions enhances story alignment and transition smoothness.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
YuE: Scaling Open Foundation Models for Long-Form Music Generation
InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation
TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrument
MuseControlLite: Multifunctional Music Generation with Lightweight Conditioners
Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models
Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.