Unsupervised Stylish Image Description Generation via Domain Layer Norm
원문 초록
Most of the existing works on image description focus on generating expressive descriptions. The only few works that are dedicated to generating stylish (e.g., romantic, lyric, etc.) descriptions suffer from limited style variation and content digression. To address these limitations, we propose a controllable stylish image description generation model. It can learn to generate stylish image descriptions that are more related to image content and can be trained with the arbitrary monolingual corpus without collecting new paired image and stylish descriptions. Moreover, it enables users to generate various stylish descriptions by plugging in style-specific parameters to include new styles into the existing model. We achieve this capability via a novel layer normalization layer design, which we will refer to as the Domain Layer Norm (DLN). Extensive experimental validation and user study on various stylish image description generation tasks are conducted to show the competitive advantages of the proposed model.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
Mitigating Hallucinations in Vision-Language Models through Image-Guided Head Suppression
Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner
VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Models
SPIDER: A Comprehensive Multi-Organ Supervised Pathology Dataset and Baseline Models
IDEA: Image Description Enhanced CLIP-Adapter
토론
이 논문과 연결된 포럼 글이 아직 없습니다.