Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactions
원문 초록
Personality computing has become an emerging topic in computer vision, due to the wide range of applications it can be used for. However, most works on the topic have focused on analyzing the individual, even when applied to interaction scenarios, and for short periods of time. To address these limitations, we present the Dyadformer, a novel multi-modal multi-subject Transformer architecture to model individual and interpersonal features in dyadic interactions using variable time windows, thus allowing the capture of long-term interdependencies. Our proposed cross-subject layer allows the network to explicitly model interactions among subjects through attentional operations. This proof-of-concept approach shows how multi-modality and joint modeling of both interactants for longer periods of time helps to predict individual attributes. With Dyadformer, we improve state-of-the-art self-reported personality inference results on individual subjects on the UDIVA v0.5 dataset.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
U-RWKV: Lightweight medical image segmentation with direction-adaptive RWKV
MambaFusion: Height-Fidelity Dense Global Fusion for Multi-modal 3D Object Detection
CDPDNet: Integrating Text Guidance with Hybrid Vision Encoders for Medical Image Segmentation
JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Model
Hybrid-Emba3D: Geometry-Aware and Cross-Path Feature Hybrid Enhanced State Space Model for Point Cloud Classification
VADMamba: Exploring State Space Models for Fast Video Anomaly Detection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.