Papers with Code 아카이브
Speech-to-Text Translation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 11
- 보존된 평가 기록
- 31
Translate audio signals of speech in one language into text in a foreign language, either in an end-to-end or cascade manner.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation
Improving Language and Modality Transfer in Translation by Character-level Modeling
Speech-to-Text Translation with Phoneme-Augmented CoT: Enhancing Cross-Lingual Transfer in Low-Resource Scenarios
BeaverTalk: Oregon State University's IWSLT 2025 Simultaneous Speech Translation System
Audio Jailbreak Attacks: Exposing Vulnerabilities in SpeechGPT in a White-Box Framework
AdaST: Dynamically Adapting Encoder States in the Decoder for End-to-End Speech-to-Text Translation
Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision
Balancing Speech Understanding and Generation Using Continual Pre-training for Codec-based Speech LLM
SparQLe: Speech Queries to Text Translation Through LLMs
Speech to Speech Translation with Translatotron: A State of the Art Review
When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation
Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding
How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?
Representation Purification for End-to-End Speech Translation
Isochrony-Controlled Speech-to-Text Translation: A study on translating from Sino-Tibetan to Indo-European Languages
Speech is More Than Words: Do Speech-to-Text Translation Systems Leverage Prosody?
Contextual Biasing to Improve Domain-specific Custom Vocabulary Audio Transcription without Explicit Fine-Tuning of Whisper Model
A Survey on Speech Large Language Models
Unveiling the Role of Pretraining in Direct Speech Translation
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation Units
Listen and Speak Fairly: A Study on Semantic Gender Bias in Speech Integrated Large Language Models
Finetuning End-to-End Models for Estonian Conversational Spoken Language Translation
Investigating Decoder-only Large Language Models for Speech-to-text Translation
NAIST Simultaneous Speech Translation System for IWSLT 2024
Voices Unheard: NLP Resources and Models for Yorùbá Regional Dialects
ArzEn-LLM: Code-Switched Egyptian Arabic-English Translation and Speech Recognition Using LLMs
SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translation
Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data?
StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning
LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned Proportions
Robust Semantic Communications for Speech Transmission
Compact Speech Translation Models via Discrete Speech Units Pretraining
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.