A Comparative Study on End-to-end Speech to Text Translation
원문 초록
Recent advances in deep learning show that end-to-end speech to text translation model is a promising approach to direct the speech translation field. In this work, we provide an overview of different end-to-end architectures, as well as the usage of an auxiliary connectionist temporal classification (CTC) loss for better convergence. We also investigate on pre-training variants such as initializing different components of a model using pre-trained models, and their impact on the final performance, which gives boosts up to 4% in BLEU and 5% in TER. Our experiments are performed on 270h IWSLT TED-talks En->De, and 100h LibriSpeech Audiobooks En->Fr. We also show improvements over the current end-to-end state-of-the-art systems on both tasks.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
BeaverTalk: Oregon State University's IWSLT 2025 Simultaneous Speech Translation System
End-to-End Speech Translation for Low-Resource Languages Using Weakly Labeled Data
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation
Improving Language and Modality Transfer in Translation by Character-level Modeling
Speech-to-Text Translation with Phoneme-Augmented CoT: Enhancing Cross-Lingual Transfer in Low-Resource Scenarios
AdaST: Dynamically Adapting Encoder States in the Decoder for End-to-End Speech-to-Text Translation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.