Text-driven Visual Synthesis with Latent Diffusion Prior
원문 초록
There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation. We present a generic approach using latent diffusion models as powerful image priors for various visual synthesis tasks. Existing methods that utilize such priors fail to use these models' full capabilities. To improve this, our core ideas are 1) a feature matching loss between features from different layers of the decoder to provide detailed guidance and 2) a KL divergence loss to regularize the predicted latent features and stabilize the training. We demonstrate the efficacy of our approach on three different applications, text-to-3D, StyleGAN adaptation, and layered image editing. Extensive results show our method compares favorably against baselines.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
AliTok: Towards Sequence Modeling Alignment between Tokenizer and Autoregressive Model
A Comprehensive Study of Decoder-Only LLMs for Text-to-Image Generation
Deep Conditional HDRI: Inverse Tone Mapping via Dual Encoder-Decoder Conditioning Method
LSegDiff: A Latent Diffusion Model for Medical Image Segmentation
Deep residual inception encoder–decoder network for medical imaging synthesis
Making Language Model a Hierarchical Classifier and Generator
토론
이 논문과 연결된 포럼 글이 아직 없습니다.