Towards Lightweight Controllable Audio Synthesis with Conditional Implicit Neural Representations
원문 초록
The high temporal resolution of audio and our perceptual sensitivity to small irregularities in waveforms make synthesizing at high sampling rates a complex and computationally intensive task, prohibiting real-time, controllable synthesis within many approaches. In this work we aim to shed light on the potential of Conditional Implicit Neural Representations (CINRs) as lightweight backbones in generative frameworks for audio synthesis. Our experiments show that small Periodic Conditional INRs (PCINRs) learn faster and generally produce quantitatively better audio reconstructions than Transposed Convolutional Neural Networks with equal parameter counts. However, their performance is very sensitive to activation scaling hyperparameters. When learning to represent more uniform sets, PCINRs tend to introduce artificial high-frequency components in reconstructions. We validate this noise can be minimized by applying standard weight regularization during training or decreasing the compositional depth of PCINRs, and suggest directions for future research.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Fast Differentiable Modal Simulation of Non-linear Strings, Membranes, and Plates
Generative diffusion model with inverse renormalization group flows
MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis
OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
Where are we in audio deepfake detection? A systematic analysis over generative and detection models
ViolinDiff: Enhancing Expressive Violin Synthesis with Pitch Bend Conditioning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.