Adaptive User-Centered Multimodal Interaction towards Reliable and Trusted Automotive Interfaces
원문 초록
With the recently increasing capabilities of modern vehicles, novel approaches for interaction emerged that go beyond traditional touch-based and voice command approaches. Therefore, hand gestures, head pose, eye gaze, and speech have been extensively investigated in automotive applications for object selection and referencing. Despite these significant advances, existing approaches mostly employ a one-model-fits-all approach unsuitable for varying user behavior and individual differences. Moreover, current referencing approaches either consider these modalities separately or focus on a stationary situation, whereas the situation in a moving vehicle is highly dynamic and subject to safety-critical constraints. In this paper, I propose a research plan for a user-centered adaptive multimodal fusion approach for referencing external objects from a moving vehicle. The proposed plan aims to provide an open-source framework for user-centered adaptation and personalization using user observations and heuristics, multimodal fusion, clustering, transfer-of-learning for model adaptation, and continuous learning, moving towards trusted human-centered artificial intelligence.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech Model
ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understanding
I2MoE: Interpretable Multimodal Interaction-aware Mixture-of-Experts
Ming-Lite-Uni: Advancements in Unified Architecture for Natural Multimodal Interaction
OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformer
Towards Explainable Multimodal Depression Recognition for Clinical Interviews
토론
이 논문과 연결된 포럼 글이 아직 없습니다.