Viewpoint Consistency in 3D Generation via Attention and CLIP Guidance
원문 초록
Despite recent advances in text-to-3D generation techniques, current methods often suffer from geometric inconsistencies, commonly referred to as the Janus Problem. This paper identifies the root cause of the Janus Problem: viewpoint generation bias in diffusion models, which creates a significant gap between the actual generated viewpoint and the expected one required for optimizing the 3D model. To address this issue, we propose a tuning-free approach called the Attention and CLIP Guidance (ACG) mechanism. ACG enhances desired viewpoints by adaptively controlling cross-attention maps, employs CLIP-based view-text similarities to filter out erroneous viewpoints, and uses a coarse-to-fine optimization strategy with staged prompts to progressively refine 3D generation. Extensive experiments demonstrate that our method significantly reduces the Janus Problem without compromising generation speed, establishing ACG as an efficient, plug-and-play component for existing text-to-3D frameworks.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Generating Physically Stable and Buildable LEGO Designs from Text
Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generation
Text-based Animatable 3D Avatars with Morphable Model Alignment
ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation
RewardSDS: Aligning Score Distillation via Reward-Weighted Sampling
Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.