CLAREL: Classification via retrieval loss for zero-shot learning
원문 초록
We address the problem of learning fine-grained cross-modal representations. We propose an instance-based deep metric learning approach in joint visual and textual space. The key novelty of this paper is that it shows that using per-image semantic supervision leads to substantial improvement in zero-shot performance over using class-only supervision. On top of that, we provide a probabilistic justification for a metric rescaling approach that solves a very common problem in the generalized zero-shot learning setting, i.e., classifying test images from unseen classes as one of the classes seen during training. We evaluate our approach on two fine-grained zero-shot learning datasets: CUB and FLOWERS. We find that on the generalized zero-shot classification task CLAREL consistently outperforms the existing approaches on both datasets.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Label Consistent Fisher Vectors for Supervised Feature Aggregation
Dare to Plagiarize? Plagiarized Painting Recognition and Retrieval
Multimodal Information Retrieval for Open World with Edit Distance Weak Supervision
Few-Shot Bearing Fault Diagnosis Via Ensembling Transformer-Based Model With Mahalanobis Distance Metric Learning From Multiscale Features
MARTA: a model for the automatic phonemic grouping of the parkinsonian speech
Semantic Structure Enhanced Contrastive Adversarial Hash Network for Cross-media Representation Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.