End-to-end Semantic Object Detection with Cross-Modal Alignment
원문 초록
Traditional semantic image search methods aim to retrieve images that match the meaning of the text query. However, these methods typically search for objects on the whole image, without considering the localization of objects within the image. This paper presents an extension of existing object detection models for semantic image search that considers the semantic alignment between object proposals and text queries, with a focus on searching for objects within images. The proposed model uses a single feature extractor, a pre-trained Convolutional Neural Network, and a transformer encoder to encode the text query. Proposal-text alignment is performed using contrastive learning, producing a score for each proposal that reflects its semantic alignment with the text query. The Region Proposal Network (RPN) is used to generate object proposals, and the end-to-end training process allows for an efficient and effective solution for semantic image search. The proposed model was trained end-to-end, providing a promising solution for semantic image search that retrieves images that match the meaning of the text query and generates semantically relevant object proposals.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Class Agnostic Instance-level Descriptor for Visual Instance Search
RadiomicsRetrieval: A Customizable Framework for Medical Image Retrieval Using Radiomics Features
Weakly-supervised Contrastive Learning with Quantity Prompts for Moving Infrared Small Target Detection
Towards Reliable Detection of Empty Space: Conditional Marked Point Processes for Object Detection
A Real-Time System for Egocentric Hand-Object Interaction Detection in Industrial Domains
DreamGrasp: Zero-Shot 3D Multi-Object Reconstruction from Partial-View Images for Robotic Manipulation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.