https://github.com/sparkaudio/spark-tts
공식 코드Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
Papers with Code 아카이브
Audio-Visual Speech Recognition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 4
- 보존된 평가 기록
- 24
Audio-visual speech recognition is the task of transcribing a paired audio and visual stream into text.
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/spkgyk/RTFS-Net
공식 코드RTFS-Net: Recurrent Time-Frequency Modelling for Efficient Audio-Visual Speech Separation
https://github.com/springhuo/mavd
공식 코드MAVD: The First Open Large-Scale Mandarin Audio-Visual Dataset with Depth Information
https://github.com/ssmlkl/mntts2
공식 코드MnTTS2: An Open-Source Multi-Speaker Mongolian Text-to-Speech Synthesis Dataset
https://github.com/sungnyun/avsr-temporal-dynamics
공식 코드https://github.com/sungnyun/cav2vec
공식 코드Multi-Task Corrupted Prediction for Learning Robust Audio-Visual Speech Representation
https://github.com/suzhiba/Full-parallel_100x_real_time_End2EndTTS
공식 코드https://github.com/sweatybridge/text-to-anime
공식 코드https://github.com/takaaki-saeki/zm-text-tts
공식 코드https://github.com/talkingnow/HM-Conformer
공식 코드https://github.com/tensorflow/tensor2tensor
공식 코드On the Discrepancy between Density Estimation and Sequence Generation
https://github.com/theodorblackbird/lina-speech
공식 코드Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis
https://github.com/thudm/glm-4-voice
공식 코드GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbot
https://github.com/thuhcsi/flattn
공식 코드An End-to-end Chinese Text Normalization Model based on Rule-guided Flat-Lattice Transformer
https://github.com/thuhcsi/spanpsp
공식 코드A Character-level Span-based Model for Mandarin Prosodic Structure Prediction
https://github.com/tianduowang/speech-bt
공식 코드From Tens of Hours to Tens of Thousands: Scaling Back-Translation for Speech Recognition
https://github.com/tiberiu44/TTS-Cube
공식 코드https://github.com/tkc-morita/ZeroSpeech2020_TTSwoT
공식 코드https://github.com/tobuta/PolyGlotFake
공식 코드PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset
https://github.com/tonychenxyz/emoknob
공식 코드EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control
https://github.com/tts-tutorial/survey
공식 코드https://github.com/ttsds/ttsds
공식 코드https://github.com/ttslr/strengthnet
공식 코드Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on Data-Driven Deep Learning
https://github.com/umbertocappellazzo/llama-avsr
공식 코드Large Language Models are Strong Audio-Visual Speech Recognition Learners
https://github.com/vinairesearch/xphonebert
공식 코드XPhoneBERT: A Pre-trained Multilingual Model for Phoneme Representations for Text-to-Speech
https://github.com/vita-mllm/vita-audio
공식 코드VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
https://github.com/vivian556123/neurips2024-covomix
공식 코드CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
https://github.com/walker-hyf/fctalker
공식 코드FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis
https://github.com/walker-hyf/mntts
공식 코드MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied Baseline
https://github.com/wanghelin1997/aty-tts
공식 코드Improving fairness for spoken language understanding in atypical speech with Text-to-Speech
https://github.com/winddori2002/dex-tts
공식 코드DEX-TTS: Diffusion-based EXpressive Text-to-Speech with Style Modeling on Time Variability
https://github.com/wutong8023/speechre
공식 코드https://github.com/wxzyd123/pivotal_objective_perturbation
공식 코드Mitigating Unauthorized Speech Synthesis for Voice Protection
https://github.com/xiangli2022/cm-tts
공식 코드https://github.com/xincanfeng/vitsgpt
공식 코드https://github.com/xinleiniu/latentoptimalpathsbayesiandp
공식 코드Latent Optimal Paths by Gumbel Propagation for Variational Bayesian Dynamic Programming
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.