Papers with Code 아카이브
Audio Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 4
- 평가표
- 3
- 보존된 평가 기록
- 26
Audio generation (synthesis) is the task of generating raw audio such as speech.
<span style="color:grey; opacity: 0.6">( Image credit: MelNet )</span>
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens
FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
SOAF: Scene Occlusion-aware Neural Acoustic Field
FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds
Taming Data and Transformers for Audio Generation
Text-Queried Target Sound Event Localization
Provable Statistical Rates for Consistency Diffusion Models
A multi-speaker multi-lingual voice cloning system based on vits2 for limmits 2024 challenge
Improving Text-To-Audio Models with Synthetic Captions
Can Synthetic Audio From Generative Foundation Models Assist Audio Recognition and Speech Modeling?
DubWise: Video-Guided Speech Duration Control in Multimodal LLM-based Text-to-Speech for Dubbing
Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio
LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation
Spoken Language Corpora Augmentation with Domain-Specific Voice-Cloned Speech
Just Because We Camp, Doesn't Mean We Should: The Ethics of Modelling Queer Voices
Hearing Anything Anywhere
AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation
Autoregressive Diffusion Transformer for Text-to-Speech Synthesis
XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model
Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis
SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound
Stochastic Diffusion: A Diffusion Probabilistic Model for Stochastic Time Series Forecasting
Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformer
Creative Text-to-Audio Generation via Synthesizer Programming
Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching
AudioLCM: Text-to-Audio Generation with Latent Consistency Models
A Survey of Deep Learning Audio Generation Methods
SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation
C3LLM: Conditional Multimodal Content Generation Using Large Language Models
Visual Echoes: A Simple Unified Transformer for Audio-Visual Generation
The Rarity of Musical Audio Signals Within the Space of Possible Audio Generation
Non-autoregressive real-time Accent Conversion model with voice cloning
PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset
Prompt-guided Precise Audio Editing with Diffusion Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.