Image-text matching
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 1
- 보존된 평가 기록
- 8
Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.
Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding
Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmark
Revisiting the Role of Language Priors in Vision-Language Models
Improved Probabilistic Image-Text Representations
Are Diffusion Models Vision-And-Language Reasoners?
Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
MALM: Mask Augmentation based Local Matching for Food-Recipe Retrieval
Probing the Role of Positional Information in Vision-Language Models
Scene Text Recognition with Image-Text Matching-guided Dictionary
Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Information
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models
Multi-Modal Representation Learning with Text-Driven Soft Masks
Multimodal Image-Text Matching Improves Retrieval-based Chest X-Ray Report Generation
Integrating Language Guidance Into Image-Text Matching for Correcting False Negatives
Increasing Textual Context Size Boosts Medical Image-Text Matching
Plug-and-Play Regulators for Image-Text Matching
BiCro: Noisy Correspondence Rectification for Multi-modality Data via Bi-directional Cross-modal Similarity Consistency
Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval
Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training
Selectively Hard Negative Mining for Alleviating Gradient Vanishing in Image-Text Matching
BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus Decoding
Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection
Uniform Masking Prevails in Vision-Language Pretraining
ComCLIP: Training-Free Compositional Image and Text Matching
Self-supervised vision-language pretraining for Medical visual question answering
UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance
DOMFN: A Divergence-Orientated Multi-Modal Fusion Network for Resume Assessment
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?
Dissecting Deep Metric Learning Losses for Image-Text Retrieval
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model
GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-training
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and Retrieval
Zero-Shot Video Captioning with Evolving Pseudo-Tokens
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.