Papers with Code 아카이브
Image Retrieval with Multi-Modal Query
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 4
- 평가표
- 3
- 보존된 평가 기록
- 15
The problem of retrieving images from a database based on a multi-modal (image- text) query. Specifically, the query text prompts some modification in the query image and the task is to retrieve images with the desired modifications.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Dependency Structure Augmented Contextual Scoping Framework for Multimodal Aspect-Based Sentiment Analysis
PATFinger: Prompt-Adapted Transferable Fingerprinting against Unauthorized Multimodal Dataset Usage
Learning Sparse Disentangled Representations for Multimodal Exclusion Retrieval
FineLIP: Extending CLIP's Reach via Fine-Grained Alignment with Longer Text Inputs
LRSCLIP: A Vision-Language Foundation Model for Aligning Remote Sensing Image with Longer Text
Seeing Speech and Sound: Distinguishing and Locating Audios in Visual Scenes
PromptHash: Affinity-Prompted Collaborative Cross-Modal Learning for Adaptive Hashing Retrieval
Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatology
Aligning Information Capacity Between Vision and Language via Dense-to-Sparse Feature Distillation for Image-Text Matching
Adaptive Inner Speech-Text Alignment for LLM-based Speech Translation
NeighborRetr: Balancing Hub Centrality in Cross-Modal Retrieval
Astrea: A MOE-based Visual Understanding Model with Progressive Alignment
A Recipe for Improving Remote Sensing VLM Zero Shot Generalization
CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIP
X2CT-CLIP: Enable Multi-Abnormality Detection in Computed Tomography from Chest Radiography via Tri-Modal Contrastive Learning
Composed Multi-modal Retrieval: A Survey of Approaches and Applications
Recurrence-Enhanced Vision-and-Language Transformers for Robust Multimodal Document Retrieval
IteRPrimE: Zero-shot Referring Image Segmentation with Iterative Grad-CAM Refinement and Primary Word Emphasis
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations
Lightweight Contrastive Distilled Hashing for Online Cross-modal Retrieval
CLIP Under the Microscope: A Fine-Grained Analysis of Multi-Object Representation
ReCon: Enhancing True Correspondence Discrimination through Relation Consistency for Robust Noisy Correspondence Learning
On the Importance of Text Preprocessing for Multimodal Representation Learning and Pathology Report Generation
Pathology Report Generation and Multimodal Representation Learning for Cutaneous Melanocytic Lesions
Object-centric Binding in Contrastive Language-Image Pretraining
CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency
GAIA: A Global, Multi-modal, Multi-scale Vision-Language Dataset for Remote Sensing Image Analysis
Zero-Shot Interactive Text-to-Image Retrieval via Diffusion-Augmented Representations
MASS: Overcoming Language Bias in Image-Text Matching
TSVC:Tripartite Learning with Semantic Variation Consistency for Robust Image-Text Retrieval
FiLo++: Zero-/Few-Shot Anomaly Detection by Fused Fine-Grained Descriptions and Deformable Localization
Deep Reversible Consistency Learning for Cross-modal Retrieval
Robust Self-Paced Hashing for Cross-Modal Retrieval with Noisy Labels
Towards Identity-Aware Cross-Modal Retrieval: a Dataset and a Baseline
Multi-Head Attention Driven Dynamic Visual-Semantic Embedding for Enhanced Image-Text Matching
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.