ReaLJam: Real-Time Human-AI Music Jamming with Reinforcement Learning-Tuned Transformers
원문 초록
Recent advances in generative artificial intelligence (AI) have created models capable of high-quality musical content generation. However, little consideration is given to how to use these models for real-time or cooperative jamming musical applications because of crucial required features: low latency, the ability to communicate planned actions, and the ability to adapt to user input in real-time. To support these needs, we introduce ReaLJam, an interface and protocol for live musical jamming sessions between a human and a Transformer-based AI agent trained with reinforcement learning. We enable real-time interactions using the concept of anticipation, where the agent continually predicts how the performance will unfold and visually conveys its plan to the user. We conduct a user study where experienced musicians jam in real-time with the agent through ReaLJam. Our results demonstrate that ReaLJam enables enjoyable and musically interesting sessions, and we uncover important takeaways for future work.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
$τ^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
Comparative Analysis of AI Agent Architectures for Entity Relationship Classification
ThinkTank: A Framework for Generalizing Domain-Specific AI Agent Systems into Universal Collaborative Intelligence Platforms
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning
Will Agents Replace Us? Perceptions of Autonomous Multi-Agent AI
From Knowledge to Noise: CTIM-Rover and the Pitfalls of Episodic Memory in Software Engineering Agents
토론
이 논문과 연결된 포럼 글이 아직 없습니다.