Papers with Code 아카이브

Image Retrieval with Multi-Modal Query

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법 전체 데이터셋

하위 태스크: 4
평가표: 3
보존된 평가 기록: 15

The problem of retrieving images from a database based on a multi-modal (image- text) query. Specifically, the query text prompts some modification in the query image and the task is to retrieve images with the desired modifications.

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/sunnychencool/AOQ

공식 코드

Adaptive Offline Quintuplet Loss for Image-Text Matching

https://github.com/tamim-el/dsokr

공식 코드

Deep Sketched Output Kernel Regression for Structured Prediction

https://github.com/technicolor-research/dsve-loc

공식 코드

Finding beans in burgers: Deep semantic-visual embedding with localization

https://github.com/threesr/unifine

공식 코드

UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding

https://github.com/top34051/colorswap

공식 코드

ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation

https://github.com/trec-atomic/atomic

공식 코드

AToMiC: An Image/Text Retrieval Test Collection to Support Multimedia Content Creation

https://github.com/txh-mercury/vast

공식 코드

VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset

https://github.com/ubc-tea/backdoor_multimodal_foundation_model

공식 코드

Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIP

https://github.com/ushasi/CMIR-NET-A-deep-learning-based-model-for-cross-modal-retrieval-in-remote-sensing

공식 코드

CMIR-NET : A Deep Learning Based Model For Cross-Modal Retrieval In Remote Sensing

https://github.com/uta-smile/TCL

공식 코드

Vision-Language Pre-Training with Triple Contrastive Learning

https://github.com/vaishwarya96/GroVE

공식 코드

Probabilistic Embeddings for Frozen Vision-Language Models: Uncertainty Quantification with Gaussian Process Latent Variable Models

https://github.com/vcm-project233/mitml

공식 코드

Learning Modal-Invariant and Temporal-Memory for Video-based Visible-Infrared Person Re-Identification

https://github.com/vkhoi/cora_cvpr24

공식 코드

Composing Object Relations and Attributes for Image-Text Matching

https://github.com/wangzhecheng/skyscript

공식 코드

SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing

https://github.com/wayne980/PolyLoss

공식 코드

Universal Weighting Metric Learning for Cross-Modal Matching

https://github.com/wenchuan-zhang/patho-r1

공식 코드

Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner

https://github.com/winycg/clip-kd

공식 코드

CLIP-KD: An Empirical Study of CLIP Model Distillation

https://github.com/wisdomikezogwo/quilt1m

공식 코드

Quilt-1M: One Million Image-Text Pairs for Histopathology

https://github.com/wjpoom/spec

공식 코드

Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding

https://github.com/woodfrog/vse_infty

공식 코드

Learning the Best Pooling Strategy for Visual Semantic Embedding

https://github.com/wzhings/itmafa

공식 코드

Enhancing Image-Text Matching with Adaptive Feature Aggregation

https://github.com/x-plug/youku-mplug

공식 코드

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks

https://github.com/xandery-geek/badcm

공식 코드

BadCM: Invisible Backdoor Attack Against Cross-Modal Learning

https://github.com/xiaoyuan1996/AMFMN

공식 코드

Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrieval

https://github.com/xiaoyuan1996/galr

공식 코드

Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Information

https://github.com/xiaoyuan1996/semanticlocalizationmetrics

공식 코드

Learning to Evaluate Performance of Multi-modal Semantic Localization

https://github.com/xsc1234/invisible-relevance-bias

공식 코드

Invisible Relevance Bias: Text-Image Retrieval Models Prefer AI-Generated Images

https://github.com/xu5zhao/bicro

공식 코드

BiCro: Noisy Correspondence Rectification for Multi-modality Data via Bi-directional Cross-modal Similarity Consistency

https://github.com/xurige1995/3shnet

공식 코드

3SHNet: Boosting Image-Sentence Retrieval via Visual Semantic-Spatial Self-Highlighting

https://github.com/yangong23/vsenetworkslseh

공식 코드

Improving Visual-Semantic Embeddings by Learning Semantically-Enhanced Hard Negatives for Cross-modal Information Retrieval

https://github.com/yaohungt/Pointwise_Dependency_Neural_Estimation

공식 코드

Neural Methods for Point-wise Dependency Estimation

https://github.com/yehli/xmodaler

공식 코드

X-modaler: A Versatile and High-performance Codebase for Cross-modal Analytics

https://github.com/yilinye/modal-fusion-map

공식 코드

ModalChorus: Visual Probing and Alignment of Multi-modal Embeddings via Modal Fusion Map

https://github.com/yimuwangcs/Better_Cross_Modal_Retrieval

공식 코드

Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks

https://github.com/ykumards/eclip

공식 코드

Improving Medical Multi-modal Contrastive Learning with Expert Annotations

https://github.com/yoadtew/zero-shot-video-to-text

공식 코드

Zero-Shot Video Captioning with Evolving Pseudo-Tokens

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.