SpectralGaussians: Semantic, spectral 3D Gaussian splatting for multi-spectral scene representation, visualization and analysis
원문 초록
We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the representation of scenes with multiple spectra, providing insights into the underlying materials and segmentation. We introduce an improved physically-based rendering approach for Gaussian splats, estimating reflectance and lights per spectra, thereby enhancing accuracy and realism. In a comprehensive quantitative and qualitative evaluation, we demonstrate the superior performance of our approach with respect to other recent learning-based spectral scene representation approaches (i.e., XNeRF and SpectralNeRF) as well as other non-spectral state-of-the-art learning-based approaches. Our work also demonstrates the potential of spectral scene understanding for precise scene editing techniques like style transfer, inpainting, and removal. Thereby, our contributions address challenges in multi-spectral scene representation, rendering, and editing, offering new possibilities for diverse applications.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Training-Free Hierarchical Scene Understanding for Gaussian Splatting with Superpoint Graphs
VoteSplat: Hough Voting Gaussian Splatting for 3D Scene Understanding
SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting
OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splatting
OmniIndoor3D: Comprehensive Indoor 3D Reconstruction
FHGS: Feature-Homogenized Gaussian Splatting
토론
이 논문과 연결된 포럼 글이 아직 없습니다.