Papers with Code 아카이브

Visual Question Answering

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법전체 데이터셋

하위 태스크

5

평가표

30

보존된 평가 기록

334

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/yikang-li/iqan

Simple Baseline for Visual Question Answering

https://github.com/yiskw713/ClassActivationMapping

Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization

https://github.com/yiskw713/RISE

Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization

https://github.com/yiskw713/SmoothGradCAMplusplus

Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization

https://github.com/yiskw713/scorecam

Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization

https://github.com/ylingfeng/FGVP

ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension

https://github.com/yonatanbitton/automatic_generation_of_contrast_sets_from_scene_graphs

Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA

https://github.com/yukw777/videoblip

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models

https://github.com/yulong-XJTU/SimVLM

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

https://github.com/yzgrfsy/tf-fastrcnn-crop

Spatial Memory for Context Reasoning in Object Detection

https://github.com/zach-zhiling-zheng/reticular_chemist

GPT-4 Technical Report

https://github.com/zebangcheng/emotion-llama

MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning

https://github.com/zhangwenyao1/open6dor_v2_execution

SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation

https://github.com/zhaochen0110/openthinkimg

Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models

https://github.com/zhaoolee/garss

LLaVA-CoT: Let Vision Language Models Reason Step-by-Step

https://github.com/zhijie-group/r1-zero-vsi

Improved Visual-Spatial Reasoning via R1-Zero-Like Training

https://github.com/zhixinlai/llmboostmedical

Frozen Transformers in Language Models Are Effective Visual Encoder Layers

https://github.com/zihanzhaosjtu/librisqa

PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering

https://github.com/zihaow123/unimm

ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks

https://github.com/zijieli-Jlee/Dual-Diffusion

Dual Diffusion for Unified Image Generation and Understanding

https://github.com/zilongzheng/visdial-gnn

Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning

https://github.com/ziwei-zheng/nullu

Evaluating Object Hallucination in Large Vision-Language Models

https://github.com/zixuwang1996/VQA-reading-list

Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering

https://github.com/ziyan-xiaoyu/spatialmqa

Visual Spatial Reasoning

https://github.com/zjukg/maco

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

https://github.com/zjukg/mygo

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

https://github.com/zjukg/snag

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

https://github.com/zxqcreations/faster-rcnn-tf

Spatial Memory for Context Reasoning in Object Detection

https://github.com/zyang1580/binllm

MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models

https://gitlab.com/Percipiote/skelda

EgoHumans: An Egocentric 3D Multi-Human Benchmark

https://huggingface.co/datasets/Fangjun/RoomSpace

Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning

https://huggingface.co/datasets/WaltonFuture/InstructionGPT-4

InstructionGPT-4: A 200-Instruction Paradigm for Fine-Tuning MiniGPT-4

https://huggingface.co/datasets/jjjjh/MM-Instruct

MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment

https://huggingface.co/spaces/daeron/CONVS2S-EVJVQA-DEMO

Integrating Image Features with Convolutional Sequence-to-sequence Network for Multilingual Visual Question Answering

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.