Papers with Code 아카이브

Visual Question Answering

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법전체 데이터셋

하위 태스크

5

평가표

30

보존된 평가 기록

334

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/airsplay/lxmert

공식 코드

LXMERT: Learning Cross-Modality Encoder Representations from Transformers

https://github.com/akirafukui/vqa-mcb

공식 코드

Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding

https://github.com/akshaygopalkr/em-vlm4ad

공식 코드

Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Driving

https://github.com/alanaai/evud

공식 코드

AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video Understanding

https://github.com/alanlusun/openkd

공식 코드

OpenKD: Opening Prompt Diversity for Zero- and Few-shot Keypoint Detection

https://github.com/alexdelitzas/3d-vqa

공식 코드

CLIP-Guided Vision-Language Pre-training for Question Answering in 3D Scenes

https://github.com/ali-vilab/VGen

공식 코드

Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation

https://github.com/alibaba-nlp/omnisearch

공식 코드

Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent

https://github.com/alibaba/AliceMind

공식 코드

StructuralLM: Structural Pre-training for Form Understanding

https://github.com/alibaba/AliceMind/tree/main/mPLUG

공식 코드

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections

https://github.com/alibaba/conv-llava

공식 코드

ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models

https://github.com/alibabaresearch/advancedliteratemachinery

공식 코드

ProcTag: Process Tagging for Assessing the Efficacy of Document Instruction Data

https://github.com/aliborji/binaryvqa

공식 코드

BinaryVQA: A Versatile Test Set to Evaluate the Out-of-Distribution Generalization of VQA Models

https://github.com/alice01010101/tasu

공식 코드

In-the-wild Audio Spatialization with Flexible Text-guided Localization

https://github.com/alignmentresearch/vlmrm

공식 코드

Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learning

https://github.com/alirezasalemi7/dedr-mm-fid

공식 코드

A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering

https://github.com/alirezasalemi7/pretraining-multimodal-dense-retriever-for-okvqa

공식 코드

Pre-Training Multi-Modal Dense Retrievers for Outside-Knowledge Visual Question Answering

https://github.com/allenai/ai2thor

공식 코드

AI2-THOR: An Interactive 3D Environment for Visual AI

https://github.com/allenai/aokvqa

공식 코드

A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge

https://github.com/allenai/close

공식 코드

I Can't Believe There's No Images! Learning Visual Tasks Using only Language Supervision

https://github.com/allenai/gpv-1

공식 코드

Towards General Purpose Vision Systems

https://github.com/allenai/grit_official

공식 코드

GRIT: General Robust Image Task Benchmark

https://github.com/allenai/reclip

공식 코드

ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension

https://github.com/allenai/visual-reasoning-rationalization

공식 코드

Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs

https://github.com/allenai/x-lxmert

공식 코드

X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers

https://github.com/alpha-vllm/llama2-accessory

공식 코드

SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language Models

https://github.com/alpha-vllm/lumina-mgpt

공식 코드

Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining

https://github.com/amazon-research/mix-generation

공식 코드

MixGen: A New Multi-Modal Data Augmentation

https://github.com/amazon-science/camml

공식 코드

CaMML: Context-Aware Multimodal Learner for Large Models

https://github.com/amiroor/d3questiongenerationclevr

공식 코드

D3: Data Diversity Design for Systematic Generalization in Visual Question Answering

https://github.com/amitakamath/whatsup_vlms

공식 코드

What's "up" with vision-language models? Investigating their struggle with spatial reasoning

https://github.com/andersonstra/mukea

공식 코드

MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering

https://github.com/andst/text_guided_cl

공식 코드

Text-Guided Image Clustering

https://github.com/anonymousanoy/fohe

공식 코드

Mitigating Fine-Grained Hallucination by Fine-Tuning Large Vision-Language Models with Caption Rewrites

https://github.com/antoyang/FrozenBiLM

공식 코드

Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

https://github.com/antoyang/just-ask

공식 코드

Just Ask: Learning to Answer Questions from Millions of Narrated Videos

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.