Peking Opera Synthesis via Duration Informed Attention Network
원문 초록
Peking Opera has been the most dominant form of Chinese performing art since around 200 years ago. A Peking Opera singer usually exhibits a very strong personal style via introducing improvisation and expressiveness on stage which leads the actual rhythm and pitch contour to deviate significantly from the original music score. This inconsistency poses a great challenge in Peking Opera singing voice synthesis from a music score. In this work, we propose to deal with this issue and synthesize expressive Peking Opera singing from the music score based on the Duration Informed Attention Network (DurIAN) framework. To tackle the rhythm mismatch, Lagrange multiplier is used to find the optimal output phoneme duration sequence with the constraint of the given note duration from music score. As for the pitch contour mismatch, instead of directly inferring from music score, we adopt a pseudo music score generated from the real singing and feed it as input during training. The experiments demonstrate that with the proposed system we can synthesize Peking Opera singing voice with high-quality timbre, pitch and expressiveness.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control
Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion
Enhancing the vocal range of single-speaker singing voice synthesis with melody-unsupervised pre-training
Singing Voice Synthesis Based on a Musical Note Position-Aware Attention Mechanism
From Generality to Mastery: Composer-Style Symbolic Music Generation via Large-Scale Pre-training
MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark
토론
이 논문과 연결된 포럼 글이 아직 없습니다.