https://github.com/nohtow/wtf-rl
공식 코드Distinctive Image Captioning: Leveraging Ground Truth Captions in CLIP Guided Reinforcement Learning
Papers with Code 아카이브
Image Retrieval with Multi-Modal Query
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 4
- 평가표
- 3
- 보존된 평가 기록
- 15
The problem of retrieving images from a database based on a multi-modal (image- text) query. Specifically, the query text prompts some modification in the query image and the task is to retrieve images with the desired modifications.
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/om-ai-lab/rs5m
공식 코드https://github.com/openai/CLIP
공식 코드Learning Transferable Visual Models From Natural Language Supervision
https://github.com/opengvlab/internvl
공식 코드InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
https://github.com/ovshake/cobra
공식 코드https://github.com/paranioar/rcar
공식 코드https://github.com/park-jungin/vlap
공식 코드Bridging Vision and Language Spaces with Assignment Prediction
https://github.com/paullerner/viquae
공식 코드Cross-modal Retrieval for Knowledge-based Visual Question Answering
https://github.com/pengfeiliheu/m2i2
공식 코드Self-supervised vision-language pretraining for Medical visual question answering
https://github.com/peri044/STT
공식 코드https://github.com/perquisite/drcl
공식 코드Deep Reversible Consistency Learning for Cross-modal Retrieval
https://github.com/perquisite/rshnl
공식 코드Robust Self-Paced Hashing for Cross-Modal Retrieval with Noisy Labels
https://github.com/pseulki/rococo
공식 코드RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models
https://github.com/pter61/aligncmss
공식 코드Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Search
https://github.com/ptkjw1997/dgmrec
공식 코드Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarios
https://github.com/pzzhang/VinVL
공식 코드VinVL: Revisiting Visual Representations in Vision-Language Models
https://github.com/qinyang79/crcl
공식 코드Cross-modal Active Complementary Learning with Self-refining Correspondence
https://github.com/qxzha/ReCon
공식 코드https://github.com/rajpurkarlab/x-rem
공식 코드Multimodal Image-Text Matching Improves Retrieval-based Chest X-Ray Report Generation
https://github.com/rakutentech/hq
공식 코드Efficient Cross-Modal Retrieval via Deep Binary Hashing and Quantization
https://github.com/ranarag/ZSCRGAN
공식 코드https://github.com/raoyongming/denseclip
공식 코드DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting
https://github.com/ryanwangzf/biobridge
공식 코드BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphs
https://github.com/sail-sg/ptp
공식 코드Position-guided Text Prompt for Vision-Language Pre-training
https://github.com/salesforce/lavis
공식 코드Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
https://github.com/seekerhuang/harma
공식 코드Efficient Remote Sensing with Harmonized Transfer Learning and Modality Alignment
https://github.com/sgfin/molecule_ge_coordinated_embeddings
공식 코드https://github.com/shijxcs/candle
공식 코드Efficient and Long-Tailed Generalization for Pre-trained Vision-Language Model
https://github.com/siyuanyan1/make
공식 코드https://github.com/snowstormfly/cross-modal-retrieval-mlagt
공식 코드https://github.com/songguoli87/HMGP
공식 코드Harmonized Multimodal Learning with Gaussian Process Latent Variable Models
https://github.com/soon91jae/uvwsd
공식 코드https://github.com/starxliu/FDDH
공식 코드FDDH: Fast Discriminative Discrete Hashing for Large-Scale Cross-Modal Retrieval
https://github.com/starxliu/MTFH
공식 코드MTFH: A Matrix Tri-Factorization Hashing Framework for Efficient Cross-Modal Retrieval
https://github.com/subhc/clever
공식 코드The Curious Layperson: Fine-Grained Image Recognition without Expert Labels
https://github.com/sunanhe/mkt
공식 코드Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.