Face2Text: Collecting an Annotated Image Description Corpus for the Generation of Rich Face Descriptions
원문 초록
The past few years have witnessed renewed interest in NLP tasks at the interface between vision and language. One intensively-studied problem is that of automatically generating text from images. In this paper, we extend this problem to the more specific domain of face description. Unlike scene descriptions, face descriptions are more fine-grained and rely on attributes extracted from the image, rather than objects and relations. Given that no data exists for this task, we present an ongoing crowdsourcing study to collect a corpus of descriptions of face images taken `in the wild'. To gain a better understanding of the variation we find in face description and the possible issues that this may raise, we also conducted an annotation study on a subset of the corpus. Primarily, we found descriptions to refer to a mixture of attributes, not only physical, but also emotional and inferential, which is bound to create further challenges for current image-to-text methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation
Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
Efficient Medical Vision-Language Alignment Through Adapting Masked Vision Models
Mitigating Hallucinations in Vision-Language Models through Image-Guided Head Suppression
UniMoCo: Unified Modality Completion for Robust Multi-Modal Embeddings
Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner
토론
이 논문과 연결된 포럼 글이 아직 없습니다.