Papers with Code 아카이브
Speech-to-Speech Translation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 17
Speech-to-speech translation (S2ST) consists on translating speech from one language to speech in another language. This can be done with a cascade of automatic speech recognition (ASR), text-to-text machine translation (MT), and text-to-speech (TTS) synthesis sub-systems, which is text-centric. Recently, works on S2ST without relying on intermediate text representation is emerging.
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/facebookresearch/fairseq/tree/ust/examples/hokkien
https://github.com/facebookresearch/sonar
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
https://github.com/fixie-ai/ultravox
https://github.com/ggerganov/whisper.cpp
https://github.com/huggingface/transformers
https://github.com/k2-fsa/icefall
https://github.com/kadirnar/whisper-plus
https://github.com/lucidrains/audiolm-pytorch
https://github.com/m-bain/whisperx
https://github.com/open-creator/icefall
https://github.com/plachtaa/vall-e-x
https://github.com/pwc-1/Paper-10/tree/main/seamless_m4t
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
https://github.com/pwc-1/Paper-9/tree/main/1/whisper
https://github.com/robflynnyh/long-context-asr
https://github.com/rongjiehuang/transpeech
https://github.com/sam2125/translatotron
Direct speech-to-speech translation with a sequence-to-sequence model
https://github.com/sanchit-gandhi/whisper-jax
https://github.com/serp-ai/bark-with-voice-clone
https://github.com/suno-ai/bark
https://github.com/whisperspeech/whisperspeech
https://github.com/xingchensong/s3tokenizer
https://github.com/yangyucheng000/University/tree/main/model-3/seamless_m4t
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.