HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation
원문 초록
Recent text-to-3D methods employing diffusion models have made significant advancements in 3D human generation. However, these approaches face challenges due to the limitations of text-to-image diffusion models, which lack an understanding of 3D structures. Consequently, these methods struggle to achieve high-quality human generation, resulting in smooth geometry and cartoon-like appearances. In this paper, we propose HumanNorm, a novel approach for high-quality and realistic 3D human generation. The main idea is to enhance the model's 2D perception of 3D geometry by learning a normal-adapted diffusion model and a normal-aligned diffusion model. The normal-adapted diffusion model can generate high-fidelity normal maps corresponding to user prompts with view-dependent and body-aware text. The normal-aligned diffusion model learns to generate color images aligned with the normal maps, thereby transforming physical geometry details into realistic appearance. Leveraging the proposed normal diffusion model, we devise a progressive geometry generation strategy and a multi-step Score Distillation Sampling (SDS) loss to enhance the performance of 3D human generation. Comprehensive experiments substantiate HumanNorm's ability to generate 3D humans with intricate geometry and realistic appearances. HumanNorm outperforms existing text-to-3D methods in both geometry and texture quality. The project page of HumanNorm is https://humannorm.github.io/.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generation
3D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation
Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models
EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligence
MVPainter: Accurate and Detailed 3D Texture Generation via Multi-View Diffusion with Geometric Control
NeRF-Texture: Synthesizing Neural Radiance Field Textures
토론
이 논문과 연결된 포럼 글이 아직 없습니다.