Singing voice synthesis based on frame-level sequence-to-sequence models considering vocal timing deviation
원문 초록
This paper proposes singing voice synthesis (SVS) based on frame-level sequence-to-sequence models considering vocal timing deviation. In SVS, it is essential to synchronize the timing of singing with temporal structures represented by scores, taking into account that there are differences between actual vocal timing and note start timing. In many SVS systems including our previous work, phoneme-level score features are converted into frame-level ones on the basis of phoneme boundaries obtained by external aligners to take into account vocal timing deviations. Therefore, the sound quality is affected by the aligner accuracy in this system. To alleviate this problem, we introduce an attention mechanism with frame-level features. In the proposed system, the attention mechanism absorbs alignment errors in phoneme boundaries. Additionally, we evaluate the system with pseudo-phoneme-boundaries defined by heuristic rules based on musical scores when there is no aligner. The experimental results show the effectiveness of the proposed system.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks
SVDD 2024: The Inaugural Singing Voice Deepfake Detection Challenge
CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection
Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt
토론
이 논문과 연결된 포럼 글이 아직 없습니다.