Visually Grounded Speech Models for Low-resource Languages and Cognitive Modelling
원문 초록
This dissertation examines visually grounded speech (VGS) models that learn from unlabelled speech paired with images. It focuses on applications for low-resource languages and understanding human language acquisition. We introduce a task called visually prompted keyword localisation to detect and localise keywords in speech using images. We demonstrate the effectiveness of VGS models in few-shot learning scenarios for low-resource languages like Yoruba. Additionally, we examine the mutual exclusivity bias in VGS models. Our monolingual VGS model exhibits this bias, but we found that multilingualism does not affect the bias in this VGS model similarly to what is observed in children.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Exploring internal representation of self-supervised networks: few-shot learning abilities and comparison with human semantics and recognition of objects
SQL-o1: Automatic Text-to-SQL Program Synthesis via Self-Reward Heuristic Search
Few-Shot Learning by Explicit Physics Integration: An Application to Groundwater Heat Transport
Universal Music Representations? Evaluating Foundation Models on World Music Corpora
Chameleon: A MatMul-Free Temporal Convolutional Network Accelerator for End-to-End Few-Shot and Continual Learning from Sequential Data
MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs
토론
이 논문과 연결된 포럼 글이 아직 없습니다.