Image-text matching
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 1
- 보존된 평가 기록
- 8
Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.
Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Deep Boosting Learning: A Brand-new Cooperative Approach for Image-Text Matching
SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining
FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues
Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models
RadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-training
MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasets
Image-Text Matching with Multi-View Attention
ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation
MouSi: Poly-Visual-Expert Vision-Language Models
Beyond Image-Text Matching: Verb Understanding in Multimodal Transformers Using Guided Masking
Enhancing Image-Text Matching with Adaptive Feature Aggregation
Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIP
Negative Pre-aware for Noisy Cross-modal Matching
OT-Attack: Enhancing Adversarial Transferability of Vision-Language Models via Optimal Transport Optimization
CILF-CIAE: CLIP-driven Image-Language Fusion for Correcting Inverse Age Estimation
Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding
Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language Models
MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts
Active Mining Sample Pair Semantics for Image-text Matching
A New Fine-grained Alignment Method for Image-text Matching
Cross-modal Active Complementary Learning with Self-refining Correspondence
Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Search
Dynamic Visual Semantic Sub-Embeddings and Fast Re-Ranking
Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary Tasks
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise Filtering
ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation
Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrieval
Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models
Your Negative May not Be True Negative: Boosting Image-Text Matching with False Negative Elimination
Grounded Image Text Matching with Mismatched Relation Reasoning
A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.