HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting
원문 초록
Holistic understanding of urban scenes based on RGB images is a challenging yet important problem. It encompasses understanding both the geometry and appearance to enable novel view synthesis, parsing semantic labels, and tracking moving objects. Despite considerable progress, existing approaches often focus on specific aspects of this task and require additional inputs such as LiDAR scans or manually annotated 3D bounding boxes. In this paper, we introduce a novel pipeline that utilizes 3D Gaussian Splatting for holistic urban scene understanding. Our main idea involves the joint optimization of geometry, appearance, semantics, and motion using a combination of static and dynamic 3D Gaussians, where moving object poses are regularized via physical constraints. Our approach offers the ability to render new viewpoints in real-time, yielding 2D and 3D semantic information with high accuracy, and reconstruct dynamic scenes, even in scenarios where 3D bounding box detection are highly noisy. Experimental results on KITTI, KITTI-360, and Virtual KITTI 2 demonstrate the effectiveness of our approach.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
PhysGaia: A Physics-Aware Dataset of Multi-Body Interactions for Dynamic Novel View Synthesis
VoteSplat: Hough Voting Gaussian Splatting for 3D Scene Understanding
DreamAnywhere: Object-Centric Panoramic 3D Scene Generation
SceneCompleter: Dense 3D Scene Completion for Generative Novel View Synthesis
OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splatting
ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.