Preference Alignment Improves Language Model-Based TTS
원문 초록
Recent advancements in text-to-speech (TTS) have shown that language model (LM)-based systems offer competitive performance to their counterparts. Further optimization can be achieved through preference alignment algorithms, which adjust LMs to align with the preferences of reward models, enhancing the desirability of the generated content. This study presents a thorough empirical evaluation of how preference alignment algorithms, particularly Direct Preference Optimization (DPO), enhance LM-based TTS. With a 1.15B parameter LM-based TTS model, we demonstrate that preference alignment consistently improves intelligibility, speaker similarity, and proxy subjective evaluation scores, with the latter two metrics surpassing even human speech in certain evaluations. We also show preference alignment is applicable to low-resource scenarios and effectively generalized to out-of-domain applications.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EmoNews: A Spoken Dialogue System for Expressive News Conversations
LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
Mlphon: A Multifunctional Grapheme-Phoneme Conversion Tool Using Finite State Transducers
Making Language Model a Hierarchical Classifier and Generator
CoLMbo: Speaker Language Model for Descriptive Profiling
MIDI-VALLE: Improving Expressive Piano Performance Synthesis Through Neural Codec Language Modelling
토론
이 논문과 연결된 포럼 글이 아직 없습니다.