Image-text matching
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 1
- 보존된 평가 기록
- 8
Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.
Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
A Novel Attention-based Aggregation Function to Combine Vision and Language
Deep Multimodal Neural Architecture Search
Transformer Reasoning Network for Image-Text Matching and Retrieval
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Text-Guided Neural Image Inpainting
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Graph Structured Network for Image-Text Matching
More Grounded Image Captioning by Distilling Image-Text Matching Model
InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining
Adaptive Offline Quintuplet Loss for Image-Text Matching
Expressing Objects just like Words: Recurrent Visual Embedding for Image-Text Matching
ImageBERT: Cross-modal Pre-training with Large-scale Weak-supervised Image-Text Data
W2VV++: Fully Deep Learning for Ad-hoc Video Search
UNITER: UNiversal Image-TExt Representation Learning
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
Visual Semantic Reasoning for Image-Text Matching
VL-BERT: Pre-training of Generic Visual-Linguistic Representations
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training
Matching Images and Text with Multi-modal Tensor Fusion and Re-ranking
Position Focused Attention Network for Image-Text Matching
ParNet: Position-aware Aggregated Relation Network for Image-Text matching
Stacked Cross Attention for Image-Text Matching
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval
Learning Two-Branch Neural Networks for Image-Text Matching Tasks
Dual Attention Networks for Multimodal Reasoning and Matching
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.