3M: Multi-modal Multi-task Multi-teacher Learning for Game Event Detection
원문 초록
Esports has rapidly emerged as a global phenomenon with an ever-expanding audience via platforms, like YouTube. Due to the inherent complexity nature of the game, it is challenging for newcomers to comprehend what the event entails. The chaotic nature of online chat, the fast-paced speech of the game commentator, and the game-specific user interface further compound the difficulty for users in comprehending the gameplay. To overcome these challenges, it is crucial to integrate the Multi-Modal (MM) information from the platform and understand the event. The paper introduces a new MM multi-teacher-based game event detection framework, with the ultimate goal of constructing a comprehensive framework that enhances the comprehension of the ongoing game situation. While conventional MM models typically prioritise aligning MM data through concurrent training towards a unified objective, our framework leverages multiple teachers trained independently on different tasks to accomplish the Game Event Detection. The experiment clearly shows the effectiveness of the proposed MM multi-teacher framework.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Hybrid Disagreement-Diversity Active Learning for Bioacoustic Sound Event Detection
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training
Multimodal Event Detection: Current Approaches and Defining the New Playground through LLMs and VLMs
Temporal Attention Pooling for Frequency Dynamic Convolution in Sound Event Detection
F$^3$Set: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
Explainable AI Components for Narrative Map Extraction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.