https://github.com/mhamilton723/DenseAV
공식 코드Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.
It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.
<span style="color:grey; opacity: 0.6">(Image credit: Schroff et al. 2015)</span>
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
Popularity-Aware Alignment and Contrast for Mitigating Popularity Bias
Context-self contrastive pretraining for crop type semantic segmentation
EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysis
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
UniXcoder: Unified Cross-Modal Pre-training for Code Representation
Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning
GLIPv2: Unifying Localization and Vision-Language Understanding
LLM2CLIP: Powerful Language Model Unlocks Richer Visual Representation
CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search
BankNote-Net: Open dataset for assistive universal currency recognition
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
FiGURe: Simple and Efficient Unsupervised Node Representations with Filter Augmentations
Making the Most of Text Semantics to Improve Biomedical Vision--Language Processing
Towards Principled Representation Learning from Videos for Reinforcement Learning
Learning Customized Visual Models with Retrieval-Augmented Knowledge
SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagery
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
Multi-Label Contrastive Learning for Abstract Visual Reasoning
Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrastive Learning
Frame-wise Action Representations for Long Videos via Sequence Contrastive Learning
Weak Augmentation Guided Relational Self-Supervised Learning
Design of the topology for contrastive visual-textual alignment
Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics
Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.