https://github.com/showlab/mist
공식 코드MIST: Multi-modal Iterative Spatial-Temporal Transformer for Long-form Video Question Answering
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
MIST: Multi-modal Iterative Spatial-Temporal Transformer for Long-form Video Question Answering
Are LLMs the Master of All Trades? : Exploring Domain-Agnostic Reasoning Skills of LLMs
Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language Reasoning
Benchmarking Vision-Language Contrastive Methods for Medical Representation Learning
What's in a Question: Using Visual Questions as a Form of Supervision
Teaching VLMs to Localize Specific Objects from In-context Examples
MM-GEN: Enhancing Task Performance Through Targeted Multimodal Data Curation
Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven Optimization
SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding
Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detection
Conversational Machine Reading Comprehension for Vietnamese Healthcare Texts
A Multiple Choices Reading Comprehension Corpus for Vietnamese Language Education
VlogQA: Task, Dataset, and Baseline Models for Vietnamese Spoken-Based Machine Reading Comprehension
Single-Sentence Reader: A Novel Approach for Addressing Answer Position Bias
AskChart: Universal Chart Understanding through Textual Enhancement
MM-PoE: Multiple Choice Reasoning via. Process of Elimination using Multi-Modal Models
ERVQA: A Dataset to Benchmark the Readiness of Large Vision Language Models in Hospital Environments
Advancing High Resolution Vision-Language Models in Biomedicine
Unfolding Spatial Cognition: Evaluating Multimodal Models on Visual Simulations
3DMIT: 3D Multi-modal Instruction Tuning for Scene Understanding
From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis
Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
OmniNet: A unified architecture for multi-modal multi-task learning
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist Collaboration
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.