arXiv:2401.09763
CLIP Model for Images to Textual Prompts Based on Top-k Neighbors
원문 초록
Text-to-image synthesis, a subfield of multimodal generation, has gained significant attention in recent years. We propose a cost-effective approach for image-to-prompt generation that leverages generative models to generate textual prompts without the need for large amounts of annotated data. We divide our method into two stages: online stage and offline stage. We use a combination of the CLIP model and K-nearest neighbors (KNN) algorithm. The proposed system consists of two main parts: an offline task and an online task. Our method owns the highest metric 0.612 among these models, which is 0.013, 0.055, 0.011 higher than Clip, Clip + KNN(top 10) respectively.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
OmniGen2: Exploration to Advanced Multimodal Generation
Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model
OmniGenBench: A Benchmark for Omnipotent Multimodal Generation across 50+ Tasks
Pisces: An Auto-regressive Foundation Model for Image Understanding and Generation
MADFormer: Mixed Autoregressive and Diffusion Transformers for Continuous Image Generation
MMMG: a Comprehensive and Reliable Evaluation Suite for Multitask Multimodal Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.