PBR3DGen: A VLM-guided Mesh Generation with High-quality PBR Texture
원문 초록
Generating high-quality physically based rendering (PBR) materials is important to achieve realistic rendering in the downstream tasks, yet it remains challenging due to the intertwined effects of materials and lighting. While existing methods have made breakthroughs by incorporating material decomposition in the 3D generation pipeline, they tend to bake highlights into albedo and ignore spatially varying properties of metallicity and roughness. In this work, we present PBR3DGen, a two-stage mesh generation method with high-quality PBR materials that integrates the novel multi-view PBR material estimation model and a 3D PBR mesh reconstruction model. Specifically, PBR3DGen leverages vision language models (VLM) to guide multi-view diffusion, precisely capturing the spatial distribution and inherent attributes of reflective-metalness material. Additionally, we incorporate view-dependent illumination-aware conditions as pixel-aware priors to enhance spatially varying material properties. Furthermore, our reconstruction model reconstructs high-quality mesh with PBR materials. Experimental results demonstrate that PBR3DGen significantly outperforms existing methods, achieving new state-of-the-art results for PBR estimation and mesh generation. More results and visualization can be found on our project page: https://pbr3dgen1218.github.io/.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
PhysX: Physical-Grounded 3D Asset Generation
ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understanding
WeatherEdit: Controllable Weather Editing with 4D Gaussian Field
Generating Physically Stable and Buildable LEGO Designs from Text
S3D: Sketch-Driven 3D Model Generation
Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.