Multi-modal Domain Adaptation for REG via Relation Transfer
원문 초록
Domain adaptation, which aims to transfer knowledge between domains, has been well studied in many areas such as image classification and object detection. However, for multi-modal tasks, conventional approaches rely on large-scale pre-training. But due to the difficulty of acquiring multi-modal data, large-scale pre-training is often impractical. Therefore, domain adaptation, which can efficiently utilize the knowledge from different datasets (domains), is crucial for multi-modal tasks. In this paper, we focus on the Referring Expression Grounding (REG) task, which is to localize an image region described by a natural language expression. Specifically, we propose a novel approach to effectively transfer multi-modal knowledge through a specially relation-tailored approach for the REG problem. Our approach tackles the multi-modal domain adaptation problem by simultaneously enriching inter-domain relations and transferring relations between domains. Experiments show that our proposed approach significantly improves the transferability of multi-modal domains and enhances adaptation performance in the REG problem.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Unfolding the Past: A Comprehensive Deep Learning Approach to Analyzing Incunabula Pages
A Robust Feature Downsampling Module for Remote Sensing Visual Tasks
Multistage Relation Network With Dual-Metric for Few-Shot Hyperspectral Image Classification
Topological Structure and Semantic Information Transfer Network for Cross-Scene Hyperspectral Image Classification
Automatic Detection and Image Recognition of Precision Agriculture for Citrus Diseases
Domain-Adaptive Object Detection via Uncertainty-Aware Distribution Alignment
토론
이 논문과 연결된 포럼 글이 아직 없습니다.