Papers with Code 아카이브
Speech-to-Text Translation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 11
- 보존된 평가 기록
- 31
Translate audio signals of speech in one language into text in a foreign language, either in an end-to-end or cascade manner.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Prosody in Cascade and Direct Speech-to-Text Translation: a case study on Korean Wh-Phrases
Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision
Efficient Monotonic Multihead Attention
End-to-End Speech-to-Text Translation: A Survey
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning
End-to-End Single-Channel Speaker-Turn Aware Conversational Speech Translation
LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT
Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach
Modular Speech-to-Text Translation for Zero-Shot Cross-Modal Transfer
Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing
SpeechAlign: a Framework for Speech Translation Alignment Evaluation
CoLLD: Contrastive Layer-to-layer Distillation for Compressing Multilingual Pre-trained Speech Encoders
An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text Translation
SONAR: Sentence-Level Multimodal and Language-Agnostic Representations
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
On decoder-only architecture for speech-to-text and large language model integration
AudioPaLM: A Large Language Model That Can Speak and Listen
Recent Advances in Direct Speech-to-text Translation
Improved Cross-Lingual Transfer Learning For Automatic Speech Translation
Strategies for improving low resource speech to text translation relying on pre-trained ASR models
ComSL: A Composite Speech-Language Model for End-to-End Speech-to-Text Translation
DUB: Discrete Unit Back-translation for Speech Translation
Back Translation for Speech-to-text Translation Without Transcripts
Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit
Enhancing Speech-to-Speech Translation with Multiple TTS Targets
Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages
MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation
Pre-training for Speech Translation: CTC Meets Optimal Transport
WACO: Word-Aligned Contrastive Learning for Speech Translation
M3ST: Mix at Three Levels for Speech Translation
Efficient Speech Translation with Dynamic Latent Perceivers
Don't Discard Fixed-Window Audio Segmentation in Speech-to-Text Translation
Simple and Effective Unsupervised Speech Translation
CTC Alignments Improve Autoregressive Translation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.