Layout-your-3D: Controllable and Precise 3D Generation with 2D Blueprint
원문 초록
We present Layout-Your-3D, a framework that allows controllable and compositional 3D generation from text prompts. Existing text-to-3D methods often struggle to generate assets with plausible object interactions or require tedious optimization processes. To address these challenges, our approach leverages 2D layouts as a blueprint to facilitate precise and plausible control over 3D generation. Starting with a 2D layout provided by a user or generated from a text description, we first create a coarse 3D scene using a carefully designed initialization process based on efficient reconstruction models. To enforce coherent global 3D layouts and enhance the quality of instance appearances, we propose a collision-aware layout optimization process followed by instance-wise refinement. Experimental results demonstrate that Layout-Your-3D yields more reasonable and visually appealing compositional 3D assets while significantly reducing the time required for each prompt. Additionally, Layout-Your-3D can be easily applicable to downstream tasks, such as 3D editing and object insertion. Our project page is available at:https://colezwhy.github.io/layoutyour3d/
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Generating Physically Stable and Buildable LEGO Designs from Text
Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generation
Text-based Animatable 3D Avatars with Morphable Model Alignment
ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation
RewardSDS: Aligning Score Distillation via Reward-Weighted Sampling
Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.