Spatial Cross-Attention Improves Self-Supervised Visual Representation Learning
원문 초록
Unsupervised representation learning methods like SwAV are proved to be effective in learning visual semantics of a target dataset. The main idea behind these methods is that different views of a same image represent the same semantics. In this paper, we further introduce an add-on module to facilitate the injection of the knowledge accounting for spatial cross correlations among the samples. This in turn results in distilling intra-class information including feature level locations and cross similarities between same-class instances. The proposed add-on can be added to existing methods such as the SwAV. We can later remove the add-on module for inference without any modification of the learned weights. Through an extensive set of empirical evaluations, we verify that our method yields an improved performance in detecting the class activation maps, top-1 classification accuracy, and down-stream tasks such as object detection, with different configuration settings.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Universal Fine-grained Visual Categorization by Concept Guided Learning
KnowZRel: Common Sense Knowledge-based Zero-Shot Relationship Retrieval for Generalised Scene Graph Generation
DROPEX: Disaster Rescue Operations and Probing using EXpert drones
A Confidence-Aware Matching Strategy For Generalized Multi-Object Tracking
Multi-Granularity Part Sampling Attention for Fine-Grained Visual Classification
TED-Net: Dispersal Attention for Perceiving Interaction Region in Indirectly-Contact HOI Detection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.