https://github.com/google-research-datasets/screen_qa
공식 코드ScreenAI: A Vision-Language Model for UI and Infographics Understanding
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
ScreenAI: A Vision-Language Model for UI and Infographics Understanding
Encyclopedic VQA: Visual questions about detailed properties of fine-grained categories
Fusion of Detected Objects in Text for Visual Question Answering
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding
Location-Aware Self-Supervised Transformers for Semantic Segmentation
A Dataset and Architecture for Visual Reasoning with a Working Memory
HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoning
Building Large Machine Reading-Comprehension Datasets using Paragraph Vectors
SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers
Revisiting spatio-temporal layouts for compositional action recognition
Lost in Space: Probing Fine-grained Spatial Understanding in Vision and Language Resamplers
Can Vision Language Models Learn from Visual Demonstrations of Ambiguous Spatial Reasoning?
Enhancing Interpretability and Interactivity in Robot Manipulation: A Neurosymbolic Approach
Interpreting Chest X-rays Like a Radiologist: A Benchmark with Clinical Reasoning
KAT: A Knowledge Augmented Transformer for Vision-and-Language
AdaVQA: Overcoming Language Priors with Adapted Margin Cosine Loss
Loss re-scaling VQA: Revisiting the LanguagePrior Problem from a Class-imbalance View
ELIP: Efficient Language-Image Pre-training with Fewer Vision Tokens
A Unified End-to-End Retriever-Reader Framework for Knowledge-based VQA
UNK-VQA: A Dataset and a Probe into the Abstention Ability of Multi-modal Large Models
Quantifying and Alleviating the Language Prior Problem in Visual Question Answering
Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attacks
StarVQA+: Co-training Space-Time Attention for Video Quality Assessment
LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection
ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning
DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
IRef-VLA: A Benchmark for Interactive Referential Grounding with Imperfect Language in 3D Scenes
Self-Bootstrapped Visual-Language Model for Knowledge Selection and Question Answering
Location Aware Modular Biencoder for Tourism Question Answering
SpatialScore: Towards Unified Evaluation for Multimodal Spatial Understanding
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.