GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding
원문 초록
Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field (GSNeRF), which uniquely takes image semantics into the synthesis process so that both novel view images and the associated semantic maps can be produced for unseen scenes. Our GSNeRF is composed of two stages: Semantic Geo-Reasoning and Depth-Guided Visual rendering. The former is able to observe multi-view image inputs to extract semantic and geometry features from a scene. Guided by the resulting image geometry information, the latter performs both image and semantic rendering with improved performances. Our experiments not only confirm that GSNeRF performs favorably against prior works on both novel-view image and semantic segmentation synthesis but the effectiveness of our sampling strategy for visual rendering is further verified.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
MUVOD: A Novel Multi-view Video Object Segmentation Dataset and A Benchmark for 3D Segmentation
ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentation
VoteSplat: Hough Voting Gaussian Splatting for 3D Scene Understanding
Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systems
Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environment
OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splatting
토론
이 논문과 연결된 포럼 글이 아직 없습니다.