FastLGS: Speeding up Language Embedded Gaussians with Feature Grid Mapping
원문 초록
The semantically interactive radiance field has always been an appealing task for its potential to facilitate user-friendly and automated real-world 3D scene understanding applications. However, it is a challenging task to achieve high quality, efficiency and zero-shot ability at the same time with semantics in radiance fields. In this work, we present FastLGS, an approach that supports real-time open-vocabulary query within 3D Gaussian Splatting (3DGS) under high resolution. We propose the semantic feature grid to save multi-view CLIP features which are extracted based on Segment Anything Model (SAM) masks, and map the grids to low dimensional features for semantic field training through 3DGS. Once trained, we can restore pixel-aligned CLIP embeddings through feature grids from rendered features for open-vocabulary queries. Comparisons with other state-of-the-art methods prove that FastLGS can achieve the first place performance concerning both speed and accuracy, where FastLGS is 98x faster than LERF and 4x faster than LangSplat. Meanwhile, experiments show that FastLGS is adaptive and compatible with many downstream tasks, such as 3D segmentation and 3D object inpainting, which can be easily applied to other 3D manipulation systems.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Training-Free Hierarchical Scene Understanding for Gaussian Splatting with Superpoint Graphs
VoteSplat: Hough Voting Gaussian Splatting for 3D Scene Understanding
SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting
OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splatting
OmniIndoor3D: Comprehensive Indoor 3D Reconstruction
FHGS: Feature-Homogenized Gaussian Splatting
토론
이 논문과 연결된 포럼 글이 아직 없습니다.