MMC: Multi-Modal Colorization of Images using Textual Descriptions
원문 초록
Handling various objects with different colors is a significant challenge for image colorization techniques. Thus, for complex real-world scenes, the existing image colorization algorithms often fail to maintain color consistency. In this work, we attempt to integrate textual descriptions as an auxiliary condition, along with the grayscale image that is to be colorized, to improve the fidelity of the colorization process. To do so, we have proposed a deep network that takes two inputs (grayscale image and the respective encoded text description) and tries to predict the relevant color components. Also, we have predicted each object in the image and have colorized them with their individual description to incorporate their specific attributes in the colorization process. After that, a fusion model fuses all the image objects (segments) to generate the final colorized image. As the respective textual descriptions contain color information of the objects present in the image, text encoding helps to improve the overall quality of predicted colors. In terms of performance, the proposed method outperforms existing colorization techniques in terms of LPIPS, PSNR and SSIM metrics.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Leveraging the Powerful Attention of a Pre-trained Diffusion Model for Exemplar-based Image Colorization
A GAN-Enhanced Deep Learning Framework for Rooftop Detection from Historical Aerial Imagery
Language-based Image Colorization: A Benchmark and Beyond
PixelShuffler: A Simple Image Translation Through Pixel Rearrangement
Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problems
Multi-scale HSV Color Feature Embedding for High-fidelity NIR-to-RGB Spectrum Translation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.