Image-to-Image Translation with Text Guidance
원문 초록
The goal of this paper is to embed controllable factors, i.e., natural language descriptions, into image-to-image translation with generative adversarial networks, which allows text descriptions to determine the visual attributes of synthetic images. We propose four key components: (1) the implementation of part-of-speech tagging to filter out non-semantic words in the given description, (2) the adoption of an affine combination module to effectively fuse different modality text and image features, (3) a novel refined multi-stage architecture to strengthen the differential ability of discriminators and the rectification ability of generators, and (4) a new structure loss to further improve discriminators to better distinguish real and synthetic images. Extensive experiments on the COCO dataset demonstrate that our method has a superior performance on both visual realism and semantic consistency with given descriptions.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translation
LBM: Latent Bridge Matching for Fast Image-to-Image Translation
Cora: Correspondence-aware image editing using few step diffusion
Unpaired Image-to-Image Translation for Segmentation and Signal Unmixing
Paired and Unpaired Image to Image Translation using Generative Adversarial Networks
Image-to-Image Translation with Diffusion Transformers and CLIP-Based Image Conditioning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.