F-StrIPE: Fast Structure-Informed Positional Encoding for Symbolic Music Generation
원문 초록
While music remains a challenging domain for generative models like Transformers, recent progress has been made by exploiting suitable musically-informed priors. One technique to leverage information about musical structure in Transformers is inserting such knowledge into the positional encoding (PE) module. However, Transformers carry a quadratic cost in sequence length. In this paper, we propose F-StrIPE, a structure-informed PE scheme that works in linear complexity. Using existing kernel approximation techniques based on random features, we show that F-StrIPE is a generalization of Stochastic Positional Encoding (SPE). We illustrate the empirical merits of F-StrIPE using melody harmonization for symbolic music.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
WildFX: A DAW-Powered Pipeline for In-the-Wild Audio FX Graph Modeling
TOMI: Transforming and Organizing Music Ideas for Multi-Track Compositions with Full-Song Structure
From Generality to Mastery: Composer-Style Symbolic Music Generation via Large-Scale Pre-training
Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion
Personalizable Long-Context Symbolic Music Infilling with MIDI-RWKV
LeVo: High-Quality Song Generation with Multi-Preference Alignment
토론
이 논문과 연결된 포럼 글이 아직 없습니다.