SHAMaNS: Sound Localization with Hybrid Alpha-Stable Spatial Measure and Neural Steerer
원문 초록
This paper describes a sound source localization (SSL) technique that combines an $\alpha$-stable model for the observed signal with a neural network-based approach for modeling steering vectors. Specifically, a physics-informed neural network, referred to as Neural Steerer, is used to interpolate measured steering vectors (SVs) on a fixed microphone array. This allows for a more robust estimation of the so-called $\alpha$-stable spatial measure, which represents the most plausible direction of arrival (DOA) of a target signal. As an $\alpha$-stable model for the non-Gaussian case ($\alpha$ $\in$ (0, 2)) theoretically defines a unique spatial measure, we choose to leverage it to account for residual reconstruction error of the Neural Steerer in the downstream tasks. The objective scores indicate that our proposed technique outperforms state-of-the-art methods in the case of multiple sound sources.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Hearing and Seeing Through CLIP: A Framework for Self-Supervised Sound Source Localization
Sound2Vision: Generating Diverse Visuals from Audio through Cross-Modal Latent Alignment
A Critical Assessment of Visual Sound Source Localization Models Including Negative Audio
Enhancing Sound Source Localization via False Negative Elimination
wav2pos: Sound Source Localization using Masked Autoencoders
Aligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment
토론
이 논문과 연결된 포럼 글이 아직 없습니다.