Cross-lingual topic prediction for speech using translations
원문 초록
Given a large amount of unannotated speech in a low-resource language, can we classify the speech utterances by topic? We consider this question in the setting where a small amount of speech in the low-resource language is paired with text translations in a high-resource language. We develop an effective cross-lingual topic classifier by training on just 20 hours of translated speech, using a recent model for direct speech-to-text translation. While the translations are poor, they are still good enough to correctly classify the topic of 1-minute speech segments over 70% of the time - a 20% improvement over a majority-class baseline. Such a system could be useful for humanitarian applications like crisis response, where incoming speech in a foreign low-resource language must be quickly assessed for further action.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
BeaverTalk: Oregon State University's IWSLT 2025 Simultaneous Speech Translation System
End-to-End Speech Translation for Low-Resource Languages Using Weakly Labeled Data
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation
Improving Language and Modality Transfer in Translation by Character-level Modeling
Speech-to-Text Translation with Phoneme-Augmented CoT: Enhancing Cross-Lingual Transfer in Low-Resource Scenarios
TASK AWARE MULTI-TASK LEARNING FOR SPEECH TO TEXT TASKS
토론
이 논문과 연결된 포럼 글이 아직 없습니다.