DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capability
원문 초록
In this paper we propose a novel generative approach, DiffRoll, to tackle automatic music transcription (AMT). Instead of treating AMT as a discriminative task in which the model is trained to convert spectrograms into piano rolls, we think of it as a conditional generative task where we train our model to generate realistic looking piano rolls from pure Gaussian noise conditioned on spectrograms. This new AMT formulation enables DiffRoll to transcribe, generate and even inpaint music. Due to the classifier-free nature, DiffRoll is also able to be trained on unpaired datasets where only piano rolls are available. Our experiments show that DiffRoll outperforms its discriminative counterpart by 19 percentage points (ppt.) and our ablation studies also indicate that it outperforms similar existing methods by 4.8 ppt. Source code and demonstration are available https://sony.github.io/DiffRoll/.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Scalable Approximate Algorithms for Optimal Transport Linear Models
D3RM: A Discrete Denoising Diffusion Refinement Model for Piano Transcription
Source Separation & Automatic Transcription for Music
Just Label the Repeats for In-The-Wild Audio-to-Score Alignment
Quantifying the Corpus Bias Problem in Automatic Music Transcription Systems
YourMT3+: Multi-instrument Music Transcription with Enhanced Transformer Architectures and Cross-dataset Stem Augmentation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.