https://github.com/Cadene/murel.bootstrap.pytorch
공식 코드MUREL: Multimodal Relational Reasoning for Visual Question Answering
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
MUREL: Multimodal Relational Reasoning for Visual Question Answering
MUTAN: Multimodal Tucker Fusion for Visual Question Answering
Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenes
Biomedical named entity recognition using BERT in the machine reading comprehension framework
HYDRA: A Hyper Agent for Dynamic Compositional Visual Reasoning
ROCKET-1: Mastering Open-World Interaction with Visual-Temporal Context Prompting
Overcoming Language Priors with Self-supervised Learning for Visual Question Answering
Learning Representations of Sets through Optimized Permutations
Learning to Count Objects in Natural Images for Visual Question Answering
Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension
TAB-VCR: Tags and Attributes based Visual Commonsense Reasoning Baselines
Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving
Hierarchical Attention: What Really Counts in Various NLP Tasks
Grounded Chain-of-Thought for Multimodal Large Language Models
OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model
Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation data
ChartCards: A Chart-Metadata Generation Framework for Multi-Task Chart Understanding
Cross-modal Information Flow in Multimodal Large Language Models
Adversarial Training with OCR Modality Perturbation for Scene-Text Visual Question Answering
Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training
Learning to Answer Questions in Dynamic Audio-Visual Scenarios
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.