https://github.com/xijun-cs/vila
공식 코드ViLA: Efficient Video-Language Alignment for Video Question Answering
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
ViLA: Efficient Video-Language Alignment for Video Question Answering
Medical Large Vision Language Models with Multi-Image Visual Ability
Mitigating Object Hallucination via Concentric Causal Attention
Interactive Machine Comprehension with Dynamic Knowledge Graphs
Interactive Machine Comprehension with Information Seeking Agents
3D-Aware Visual Question Answering about Parts, Poses and Occlusions
Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models
Revisiting Video Quality Assessment from the Perspective of Generalization
UGC Quality Assessment: Exploring the Impact of Saliency in Deep Feature-Based Quality Assessment
ReLaX-VQA: Residual Fragment and Layer Stack Extraction for Enhancing Video Quality Assessment
Connecting Attributions and QA Model Behavior on Realistic Counterfactuals
MM-Prompt: Cross-Modal Prompt Tuning for Continual Visual Question Answering
Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning
Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension
RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question Answering
Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering
Blind VQA on 360° Video via Progressively Learning from Pixels, Frames and Video
Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language Bootstrapping
Comprehensive Visual Question Answering on Point Clouds through Compositional Scene Manipulation
Counterfactual Samples Synthesizing for Robust Visual Question Answering
DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Models
X-modaler: A Versatile and High-performance Codebase for Cross-modal Analytics
Understanding Multimodal Hallucination with Parameter-Free Representation Alignment
RAVENEA: A Benchmark for Multimodal Retrieval-Augmented Visual Culture Understanding
Named Entity Recognition via Machine Reading Comprehension: A Multi-Task Learning Approach
Enhancing Large Vision Language Models with Self-Training on Image Comprehension
Lite Unified Modeling for Discriminative Reading Comprehension
Reference Knowledgeable Network for Machine Reading Comprehension
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.