https://github.com/jpthu17/dicosa
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenization
Learning to Localize Objects Improves Spatial Reasoning in Visual-LLMs
PaLI-X: On Scaling up a Multilingual Vision and Language Model
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training
TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
Is Space-Time Attention All You Need for Video Understanding?
MaMMUT: A Simple Architecture for Joint Learning for MultiModal Tasks
Is Space-Time Attention All You Need for Video Understanding?
Is Space-Time Attention All You Need for Video Understanding?
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
Is Space-Time Attention All You Need for Video Understanding?
AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model
Is Space-Time Attention All You Need for Video Understanding?
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
Is Space-Time Attention All You Need for Video Understanding?
Is Space-Time Attention All You Need for Video Understanding?
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.