Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothing
원문 초록
We present PHORHUM, a novel, end-to-end trainable, deep neural network methodology for photorealistic 3D human reconstruction given just a monocular RGB image. Our pixel-aligned method estimates detailed 3D geometry and, for the first time, the unshaded surface color together with the scene illumination. Observing that 3D supervision alone is not sufficient for high fidelity color reconstruction, we introduce patch-based rendering losses that enable reliable color reconstruction on visible parts of the human, and detailed and plausible color estimation for the non-visible parts. Moreover, our method specifically addresses methodological and practical limitations of prior work in terms of representing geometry, albedo, and illumination effects, in an end-to-end model where factors can be effectively disentangled. In extensive experiments, we demonstrate the versatility and robustness of our approach. Our state-of-the-art results validate the method qualitatively and for different metrics, for both geometric and color reconstruction.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DreamGrasp: Zero-Shot 3D Multi-Object Reconstruction from Partial-View Images for Robotic Manipulation
PanSt3R: Multi-view Consistent Panoptic Segmentation
SMPL Normal Map Is All You Need for Single-view Textured Human Reconstruction
PS4PRO: Pixel-to-pixel Supervision for Photorealistic Rendering and Optimization
Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attention
Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wild
토론
이 논문과 연결된 포럼 글이 아직 없습니다.