A Comprehensive Survey on Generative AI for Video-to-Music Generation
원문 초록
The burgeoning growth of video-to-music generation can be attributed to the ascendancy of multimodal generative models. However, there is a lack of literature that comprehensively combs through the work in this field. To fill this gap, this paper presents a comprehensive review of video-to-music generation using deep generative AI techniques, focusing on three key components: visual feature extraction, music generation frameworks, and conditioning mechanisms. We categorize existing approaches based on their designs for each component, clarifying the roles of different strategies. Preceding this, we provide a fine-grained classification of video and music modalities, illustrating how different categories influence the design of components within the generation pipelines. Furthermore, we summarize available multimodal datasets and evaluation metrics while highlighting ongoing challenges in the field.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
WildFX: A DAW-Powered Pipeline for In-the-Wild Audio FX Graph Modeling
TOMI: Transforming and Organizing Music Ideas for Multi-Track Compositions with Full-Song Structure
From Generality to Mastery: Composer-Style Symbolic Music Generation via Large-Scale Pre-training
Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion
Personalizable Long-Context Symbolic Music Infilling with MIDI-RWKV
LeVo: High-Quality Song Generation with Multi-Preference Alignment
토론
이 논문과 연결된 포럼 글이 아직 없습니다.