Imitation of human motion achieves natural head movements for humanoid robots in an active-speaker detection task
원문 초록
Head movements are crucial for social human-human interaction. They can transmit important cues (e.g., joint attention, speaker detection) that cannot be achieved with verbal interaction alone. This advantage also holds for human-robot interaction. Even though modeling human motions through generative AI models has become an active research area within robotics in recent years, the use of these methods for producing head movements in human-robot interaction remains underexplored. In this work, we employed a generative AI pipeline to produce human-like head movements for a Nao humanoid robot. In addition, we tested the system on a real-time active-speaker tracking task in a group conversation setting. Overall, the results show that the Nao robot successfully imitates human head movements in a natural manner while actively tracking the speakers during the conversation. Code and data from this study are available at https://github.com/dingdingding60/Humanoids2024HRI
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
UniTalk: Towards Universal Active Speaker Detection in Real World Scenarios
CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization
LASER: Lip Landmark Assisted Speaker Detection for Robustness
ASDnB: Merging Face with Body Cues For Robust Active Speaker Detection
BIAS: A Body-based Interpretable Active Speaker Approach
FabuLight-ASD: Unveiling Speech Activity via Body Language
토론
이 논문과 연결된 포럼 글이 아직 없습니다.