Papers with Code 아카이브
Speech-to-Speech Translation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 17
Speech-to-speech translation (S2ST) consists on translating speech from one language to speech in another language. This can be done with a cascade of automatic speech recognition (ASR), text-to-text machine translation (MT), and text-to-speech (TTS) synthesis sub-systems, which is text-centric. Recently, works on S2ST without relying on intermediate text representation is emerging.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Discrete Multimodal Transformers with a Pretrained Large Language Model for Mixed-Supervision Speech Processing
SeamlessExpressiveLM: Speech Language Model for Expressive Speech-to-Speech Translation with Chain-of-Thought
TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
CrossVoice: Crosslingual Prosody Preserving Cascade-S2ST using Transfer Learning
DiffNorm: Self-Supervised Normalization for Non-autoregressive Speech-to-speech Translation
MSLM-S2ST: A Multitask Speech Language Model for Textless Speech-to-Speech Translation with Speaker Style Preservation
Direct Punjabi to English speech translation using discrete units
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
A Case Study on Filtering for End-to-End Speech Translation
TranSentence: Speech-to-speech Translation via Language-agnostic Sentence-level Speech Encoding without Language-parallel Data
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation
EmphAssess : a Prosodic Benchmark on Assessing Emphasis Transfer in Speech-to-Speech Models
AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
DiffS2UT: A Semantic Preserving Diffusion Model for Textless Direct Speech-to-Speech Translation
Enhancing expressivity transfer in textless speech-to-speech translation
DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation
Direct Text to Speech Translation System using Acoustic Units
Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
Multilingual Speech-to-Speech Translation into Multiple Target Languages
Towards cross-language prosody transfer for dialog
AudioPaLM: A Large Language Model That Can Speak and Listen
PolyVoice: Language Models for Speech to Speech Translation
Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models
Translatotron 3: Speech to Speech Translation with Monolingual Data
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation
Textless Speech-to-Speech Translation With Limited Parallel Data
i-Code Studio: A Configurable and Composable Framework for Integrative AI
Duplex Diffusion Models Improve Speech-to-Speech Translation
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit
Enhancing Speech-to-Speech Translation with Multiple TTS Targets
Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling
A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation
BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.