Training-free Stylized Text-to-Image Generation with Fast Inference
원문 초록
Although diffusion models exhibit impressive generative capabilities, existing methods for stylized image generation based on these models often require textual inversion or fine-tuning with style images, which is time-consuming and limits the practical applicability of large-scale diffusion models. To address these challenges, we propose a novel stylized image generation method leveraging a pre-trained large-scale diffusion model without requiring fine-tuning or any additional optimization, termed as OmniPainter. Specifically, we exploit the self-consistency property of latent consistency models to extract the representative style statistics from reference style images to guide the stylization process. Additionally, we then introduce the norm mixture of self-attention, which enables the model to query the most relevant style patterns from these statistics for the intermediate output content features. This mechanism also ensures that the stylized results align closely with the distribution of the reference style images. Our qualitative and quantitative experimental results demonstrate that the proposed method outperforms state-of-the-art approaches.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CharaConsist: Fine-Grained Consistent Character Generation
NeoBabel: A Multilingual Open Tower for Visual Generation
Ovis-U1 Technical Report
Rethink Sparse Signals for Pose-guided Text-to-image Generation
XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation
ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.