A Multimodal Fusion Network For Student Emotion Recognition Based on Transformer and Tensor Product
원문 초록
This paper introduces a new multi-modal model based on the Transformer architecture and tensor product fusion strategy, combining BERT's text vectors and ViT's image vectors to classify students' psychological conditions, with an accuracy of 93.65%. The purpose of the study is to accurately analyze the mental health status of students from various data sources. This paper discusses modal fusion methods, including early, late and intermediate fusion, to overcome the challenges of integrating multi-modal information. Ablation studies compare the performance of different models and fusion techniques, showing that the proposed model outperforms existing methods such as CLIP and ViLBERT in terms of accuracy and inference speed. Conclusions indicate that while this model has significant advantages in emotion recognition, its potential to incorporate other data modalities provides areas for future research.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representations
MambaFusion: Height-Fidelity Dense Global Fusion for Multi-modal 3D Object Detection
Weakly-supervised Contrastive Learning with Quantity Prompts for Moving Infrared Small Target Detection
Improve Underwater Object Detection through YOLOv12 Architecture and Physics-informed Augmentation
Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning
LASFNet: A Lightweight Attention-Guided Self-Modulation Feature Fusion Network for Multimodal Object Detection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.