https://github.com/dvlab-research/LLMGA
공식 코드LLMGA: Multimodal Large Language Model based Generation Assistant
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
LLMGA: Multimodal Large Language Model based Generation Assistant
Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
VisionZip: Longer is Better but Not Necessary in Vision Language Models
UMIT: Unifying Medical Imaging Tasks via Vision-Language Models
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages
MLP Architectures for Vision-and-Language Modeling: An Empirical Study
Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?
Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entities
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning
Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis
One missing piece in Vision and Language: A Survey on Comics Understanding
Path-RAG: Knowledge-Guided Key Region Retrieval for Open-ended Pathology Visual Question Answering
TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Data
Visual Grounding Methods for VQA are Working for the Wrong Reasons!
Answer Them All! Toward Universal Visual Question Answering Models
Why Did the Chicken Cross the Road? Rephrasing and Analyzing Ambiguous Questions in VQA
Progressive Compositionality In Text-to-Image Generative Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.