https://github.com/rikeilong/bay-cat
공식 코드CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios
Answering Diverse Questions via Text Attached with Key Audio-Visual Clues
Systematic Generalization: What Is Required and Can It Be Learned?
RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
Open-Ended Multi-Modal Relational Reasoning for Video Question Answering
VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMs
Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning
Zero-shot Visual Question Answering with Language Model Feedback
Evaluating Object Hallucination in Large Vision-Language Models
Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering
MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs
Towards Perceiving Small Visual Details in Zero-shot Visual Question Answering with Multimodal LLMs
Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset
Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering
BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
TACO: Learning Multi-modal Action Models with Synthetic Chains-of-Thought-and-Action
Enhancing Compositional Reasoning in Vision-Language Models with Synthetic Preference Data
SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency
Subjective and Objective Analysis of Indian Social Media Video Quality
SIMPLOT: Enhancing Chart Question Answering by Distilling Essentials
Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddings
MRCBert: A Machine Reading ComprehensionApproach for Unsupervised Summarization
DeepSSN: a deep convolutional neural network to assess spatial scene similarity
A Framework for Evaluation of Machine Reading Comprehension Gold Standards
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.