https://github.com/pengfeiliheu/m2i2
공식 코드Self-supervised vision-language pretraining for Medical visual question answering
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Self-supervised vision-language pretraining for Medical visual question answering
V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
RoBIn: A Transformer-Based Model For Risk Of Bias Inference With Machine Reading Comprehension
SPhyR: Spatial-Physical Reasoning Benchmark on Material Distribution
Compressing And Debiasing Vision-Language Pre-Trained Models for Visual Question Answering
Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning
Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA
MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning
OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference
From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
On the Road with GPT-4V(ision): Early Explorations of Visual-Language Model on Autonomous Driving
Think Locally, Act Globally: Federated Learning with Local and Global Representations
ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning
ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation Reasoning
Polymath: A Challenging Multi-modal Mathematical Reasoning Benchmark
Passage Retrieval for Outside-Knowledge Visual Question Answering
CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
CARETS: A Consistency And Robustness Evaluative Test Suite for VQA
Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognition
Point and Ask: Incorporating Pointing into Visual Question Answering
FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge Injection
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.