Coherent 3D Scene Diffusion From a Single RGB Image
원문 초록
We present a novel diffusion-based approach for coherent 3D scene reconstruction from a single RGB image. Our method utilizes an image-conditioned 3D scene diffusion model to simultaneously denoise the 3D poses and geometries of all objects within the scene. Motivated by the ill-posed nature of the task and to obtain consistent scene reconstruction results, we learn a generative scene prior by conditioning on all scene objects simultaneously to capture the scene context and by allowing the model to learn inter-object relationships throughout the diffusion process. We further propose an efficient surface alignment loss to facilitate training even in the absence of full ground-truth annotation, which is common in publicly available datasets. This loss leverages an expressive shape representation, which enables direct point sampling from intermediate shape predictions. By framing the task of single RGB image 3D scene reconstruction as a conditional diffusion process, our approach surpasses current state-of-the-art methods, achieving a 12.04% improvement in AP3D on SUN RGB-D and a 13.43% increase in F-Score on Pix3D.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
R3eVision: A Survey on Robust Rendering, Restoration, and Enhancement for 3D Low-Level Vision
Tackling View-Dependent Semantics in 3D Language Gaussian Splatting
Holistic Large-Scale Scene Reconstruction via Mixed Gaussian Splatting
WeatherEdit: Controllable Weather Editing with 4D Gaussian Field
RealEngine: Simulating Autonomous Driving in Realistic Context
Hybrid 3D-4D Gaussian Splatting for Fast Dynamic Scene Representation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.