CLIPtone: Unsupervised Learning for Text-based Image Tone Adjustment
원문 초록
Recent image tone adjustment (or enhancement) approaches have predominantly adopted supervised learning for learning human-centric perceptual assessment. However, these approaches are constrained by intrinsic challenges of supervised learning. Primarily, the requirement for expertly-curated or retouched images escalates the data acquisition expenses. Moreover, their coverage of target style is confined to stylistic variants inferred from the training data. To surmount the above challenges, we propose an unsupervised learning-based approach for text-based image tone adjustment method, CLIPtone, that extends an existing image enhancement method to accommodate natural language descriptions. Specifically, we design a hyper-network to adaptively modulate the pretrained parameters of the backbone model based on text description. To assess whether the adjusted image aligns with the text description without ground truth image, we utilize CLIP, which is trained on a vast set of language-image pairs and thus encompasses knowledge of human perception. The major advantages of our approach are three fold: (i) minimal data collection expenses, (ii) support for a range of adjustments, and (iii) the ability to handle novel text descriptions unseen in training. Our approach's efficacy is demonstrated through comprehensive experiments, including a user study.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
HVI-CIDNet+: Beyond Extreme Darkness for Low-Light Image Enhancement
MAC-Lookup: Multi-Axis Conditional Lookup Model for Underwater Image Enhancement
Learning to See in the Extremely Dark
RT-X Net: RGB-Thermal cross attention network for Low-Light Image Enhancement
URWKV: Unified RWKV Model with Multi-state Perspective for Low-light Image Restoration
See through the Dark: Learning Illumination-affined Representations for Nighttime Occupancy Prediction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.