https://github.com/yangdsh/VQA-BUTD-demo
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding
CogVLM2: Visual Language Models for Image and Video Understanding
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning
VinVL: Revisiting Visual Representations in Vision-Language Models
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
InternVideo: General Video Foundation Models via Generative and Discriminative Learning
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension
Reinforced Mnemonic Reader for Machine Reading Comprehension
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Stochastic Answer Networks for Machine Reading Comprehension
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
Learning to Compose Dynamic Tree Structures for Visual Contexts
AssistQ: Affordance-centric Question-driven Task Completion for Egocentric Assistant
MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning
SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation
Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.