cross-modal alignment
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/tuyunbin/dirl
공식 코드https://github.com/uta-smile/TCL
공식 코드Vision-Language Pre-Training with Triple Contrastive Learning
https://github.com/vaishwarya96/GroVE
공식 코드https://github.com/vinh-ai/a3net
공식 코드Anatomical Attention Alignment representation for Radiology Report Generation
https://github.com/vladan-stojnic/lposs
공식 코드LPOSS: Label Propagation Over Patches and Pixels for Open-vocabulary Semantic Segmentation
https://github.com/wangyanckxx/surveyfer
공식 코드A Survey on Facial Expression Recognition of Static and Dynamic Emotions
https://github.com/wbs2788/vmb
공식 코드Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation
https://github.com/wissingchen/cra-gqa
공식 코드Cross-modal Causal Relation Alignment for Video Question Grounding
https://github.com/wqw123wqw/pftrack
공식 코드Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approach
https://github.com/xavierfav/ae-w2v-attention
공식 코드Learning Contextual Tag Embeddings for Cross-Modal Alignment of Audio and Tags
https://github.com/xijun-cs/vila
공식 코드ViLA: Efficient Video-Language Alignment for Video Question Answering
https://github.com/yanbei-jiang/artwork-interpretation
공식 코드KALE: An Artwork Image Captioning System Augmented with Heterogeneous Graph
https://github.com/yangcaoai/CoDA_NeurIPS2023
공식 코드https://github.com/yaolinli/deco
공식 코드DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Models
https://github.com/ycao5602/SAL
공식 코드Symbiotic Adversarial Learning for Attribute-based Person Search
https://github.com/yr666666/msa
공식 코드Transcending Fusion: A Multi-Scale Alignment Method for Remote Sensing Image-Text Retrieval
https://github.com/yuxiaochen1103/fdt
공식 코드https://github.com/yxchng/mask-grounding
공식 코드https://github.com/yyjmjc/loupe
공식 코드Fine-Grained Semantically Aligned Vision-Language Pre-Training
https://github.com/zgj77/fsacdm
공식 코드https://github.com/zhangweifeng1218/vfe_tps
공식 코드Enhancing Visual Representation for Text-based Person Searching
https://github.com/zhuxiangru/semvarbench
공식 코드Evaluating Semantic Variation in Text-to-Image Synthesis: A Causal Perspective
https://github.com/zihao-ai/vdc
공식 코드https://github.com/ziyuewu59/cca
공식 코드Learning Commonsense-aware Moment-Text Alignment for Fast Video Temporal Grounding
https://github.com/znlp/zero-shot-st
공식 코드Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translation
https://github.com/zplusdragon/reid5o_orbench
공식 코드ReID5o: Achieving Omni Multi-modal Person Re-identification in a Single Model
https://github.com/2024-MindSpore-1/Code2/tree/main/model-1/bridgetower
BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning
https://github.com/MindSpore-scientific-2/code-14/tree/main/layoutlmv3
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
https://github.com/hku-medai/mgca
Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning
https://github.com/huggingface/transformers
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
https://github.com/intellabs/vl-interpret
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation
https://github.com/kehanlu/DeSTA2
https://github.com/modelscope/modelscope
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
https://github.com/phantom-video/phantom
Phantom: Subject-consistent video generation via cross-modal alignment
https://github.com/pwc-1/Paper-9/tree/main/layoutlmv3
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.