Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representation
원문 초록
Generating high-quality 3D objects from textual descriptions remains a challenging problem due to computational cost, the scarcity of 3D data, and complex 3D representations. We introduce Geometry Image Diffusion (GIMDiffusion), a novel Text-to-3D model that utilizes geometry images to efficiently represent 3D shapes using 2D images, thereby avoiding the need for complex 3D-aware architectures. By integrating a Collaborative Control mechanism, we exploit the rich 2D priors of existing Text-to-Image models such as Stable Diffusion. This enables strong generalization even with limited 3D training data (allowing us to use only high-quality training data) as well as retaining compatibility with guidance techniques such as IPAdapter. In short, GIMDiffusion enables the generation of 3D assets at speeds comparable to current Text-to-Image models. The generated objects consist of semantically meaningful, separate parts and include internal structures, enhancing both usability and versatility.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Generating Physically Stable and Buildable LEGO Designs from Text
Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generation
SORT3D: Spatial Object-centric Reasoning Toolbox for Zero-Shot 3D Grounding Using Large Language Models
DiMeR: Disentangled Mesh Reconstruction Model
Text-based Animatable 3D Avatars with Morphable Model Alignment
ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.